-- Logs begin at Fri 2022-05-27 14:18:39 UTC, end at Fri 2022-05-27 15:32:44 UTC. -- May 27 15:02:48.939677 dv-cinder-842541-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 15:02:48.949170 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 15:02:48 2022] *** May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: nodename: dv-cinder-842541-3-iscsi May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: machine: x86_64 May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: clock source: unix May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: pcre jit disabled May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: detected number of CPU cores: 4 May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: current working directory: / May 27 15:02:48.951156 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: detected binary path: /usr/bin/uwsgi-core May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: your processes number limit is 47680 May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: your memory page size is 4096 bytes May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: detected max file descriptor number: 2048 May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: lock engine: pthread robust mutexes May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: thunder lock: enabled May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 15:02:48.951855 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 15:02:48.997146 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: Python main interpreter initialized at 0x5621278d09c0 May 27 15:02:48.997146 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: python threads support enabled May 27 15:02:48.997146 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: your server socket listen backlog is limited to 100 connections May 27 15:02:48.997146 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: your mercy for graceful operations on workers is 90 seconds May 27 15:02:48.997472 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: mapped 403077 bytes (393 KB) for 2 cores May 27 15:02:48.997560 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: *** Operational MODE: preforking *** May 27 15:02:48.997854 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: *** uWSGI is running in multiple interpreter mode *** May 27 15:02:48.997854 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: spawned uWSGI master process (pid: 103218) May 27 15:02:48.998052 dv-cinder-842541-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 15:02:48.998610 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: spawned uWSGI worker 1 (pid: 103219, cores: 1) May 27 15:02:48.998967 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: spawned uWSGI worker 2 (pid: 103220, cores: 1) May 27 15:02:48.999103 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 15:02:50.189490 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:02:50.194011 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:02:50.918853 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:02:50.918853 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: from cryptography.utils import int_from_bytes May 27 15:02:50.919209 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:02:50.919209 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: from cryptography.utils import int_from_bytes May 27 15:02:50.921973 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:02:50.921973 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: from cryptography.utils import int_from_bytes May 27 15:02:50.922308 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:02:50.922308 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: from cryptography.utils import int_from_bytes May 27 15:02:53.526785 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:02:53.527356 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:02:53.527536 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:02:53.527900 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:02:53.528156 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:02:53.528566 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.528896 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.529218 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.529539 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.529870 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.530182 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.530501 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.530819 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.531149 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.531407 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.531724 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.532049 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842541-3-iscsi {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.532371 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.532706 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.533018 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.533338 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.533577 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:02:53.533937 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.534019 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:02:53.534105 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.534244 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.534334 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:02:53.534675 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:02:53.534762 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535140 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:02:53.535288 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535407 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535514 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535619 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535768 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.535912 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536108 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536239 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536424 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536583 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536762 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.536900 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537085 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537213 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537396 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537531 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537722 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.537931 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538064 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538187 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538310 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538441 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842541-3-iscsi {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538624 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842541-3-iscsi {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538752 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.538942 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539070 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539244 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539381 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539550 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539720 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.539853 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.540034 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.540169 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.540387 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.540565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.540966 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.541210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.541336 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.541776 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.542015 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.542342 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.542664 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.542878 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543031 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543200 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543329 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543511 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543640 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543826 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.543979 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544165 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544294 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544493 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544646 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544805 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.544941 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545066 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545189 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545352 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545492 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545675 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545813 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.545998 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546132 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546321 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546465 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842541-3-iscsi {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546598 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546724 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.546860 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547002 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547127 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547290 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547419 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547702 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.547831 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548011 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548316 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548463 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548649 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548779 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.548958 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549085 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549265 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549572 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549708 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.549881 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550007 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550194 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550322 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550503 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550631 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550802 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.550929 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551109 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551249 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551415 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551574 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551733 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.551866 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552035 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552173 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552336 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552514 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552654 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552779 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.552910 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553044 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553203 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553341 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553522 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553650 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553839 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.553978 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554110 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554244 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554368 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554498 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554631 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554783 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.554910 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555102 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555238 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555427 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555563 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555732 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.555860 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.556111 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.556698 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557010 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557140 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557319 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557448 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557626 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557754 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.557943 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558079 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558256 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558385 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558578 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558706 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.558883 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559011 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559196 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559327 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559512 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559639 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559823 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.559960 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560130 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560249 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560439 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560608 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560774 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.560902 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561082 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561216 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561390 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561524 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561701 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.561836 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562004 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562130 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562306 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562452 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562608 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562736 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.562924 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563063 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563230 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563367 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563530 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563657 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563790 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.563923 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564054 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564262 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564534 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564671 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564798 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.564959 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565095 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565262 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565398 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565693 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.565860 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566000 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566164 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566291 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566467 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566594 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566775 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.566904 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567077 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567203 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567380 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567507 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567678 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567812 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.567980 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568114 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568282 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568409 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568588 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568723 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.568908 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569037 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569223 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569365 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569525 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569661 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569825 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.569954 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570124 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570260 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570446 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570581 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570729 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.570855 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.571029 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.571162 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.571330 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.571470 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.572172 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.572303 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.572534 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.572760 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.573007 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.573136 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.573348 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.573475 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.573679 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.573813 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.573984 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.574116 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.574300 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.574428 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.574599 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.574735 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.574903 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.575031 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.575218 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.575348 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.575523 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.575663 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.575824 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.575959 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.576125 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.576287 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.576426 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.576598 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.576734 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.576866 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.577025 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.577162 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.577332 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.577468 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.577631 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.577759 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.577926 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.578054 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.578242 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.578380 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.578560 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.578687 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.578867 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.579002 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.579172 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.579300 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.579473 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.579601 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.579787 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:02:53.579928 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580121 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580428 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580560 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580791 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.580923 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581099 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581246 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581430 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581561 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581750 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.581885 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582064 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582191 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582372 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582498 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582682 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582816 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.582989 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583116 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583300 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583425 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583608 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583750 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.583918 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584045 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584232 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584358 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584571 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584715 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.584886 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585023 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585195 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585335 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585505 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585641 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585814 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.585948 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586118 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586246 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586451 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586579 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586740 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.586878 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.587051 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.587177 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.587972 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.588264 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.588608 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.588732 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.588928 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589056 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589241 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589380 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589548 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589678 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589853 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.589992 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.590416 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.590558 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.590734 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.590870 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591038 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591175 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591357 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591484 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591682 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591808 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.591990 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592126 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592307 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592435 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592635 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592763 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.592942 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593084 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593250 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593376 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593556 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593683 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593856 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.593984 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594169 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594305 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594478 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594605 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594779 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.594907 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595084 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595211 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595398 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595530 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595704 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.595833 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596010 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596135 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596317 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596491 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596641 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596771 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.596933 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597059 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597240 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597376 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597542 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597668 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597843 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.597970 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598155 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598300 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598474 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598600 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598775 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.598910 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599086 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599220 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599388 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599527 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599695 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.599832 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600002 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600139 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600309 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600472 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600636 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600755 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.600945 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601074 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601251 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601377 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601552 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601679 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601855 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.601982 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602160 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602288 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602459 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602593 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602764 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.602891 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603093 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603221 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603398 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603656 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603797 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.603972 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604099 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604275 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604408 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604599 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604724 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.604907 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605035 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605208 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605344 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605511 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605641 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605814 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.605942 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606123 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606256 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606576 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606776 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.606913 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607078 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607190 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607404 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607512 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607724 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.607823 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608036 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608143 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608335 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608431 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608667 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608766 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.608971 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609085 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609266 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609355 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609567 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609661 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609870 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.609970 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610171 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610272 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610470 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610558 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610788 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.610889 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611070 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611182 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611369 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611469 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611684 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611782 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.611987 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612080 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612283 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612370 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612610 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612711 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612910 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.612999 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613248 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613349 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613550 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613662 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613878 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.613987 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614194 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614283 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614504 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614594 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614816 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.614903 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615124 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615227 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615433 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615538 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615736 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.615823 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616044 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616216 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616352 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616462 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616686 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.616775 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617000 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617094 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617306 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617392 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617619 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617705 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.617921 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618017 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618236 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618323 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618670 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.618963 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.619137 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.619453 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.619541 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.619770 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.619865 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620111 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620214 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620469 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620571 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620780 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.620868 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621102 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621200 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621415 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621583 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621729 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.621867 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622019 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622160 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622323 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622476 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622624 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622774 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.622923 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623063 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623201 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623339 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623478 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623624 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623771 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.623918 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624195 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624333 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624517 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624675 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624815 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.624978 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625125 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625289 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625444 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625585 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625722 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.625904 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626051 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626189 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626335 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626475 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626625 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626797 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.626951 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627242 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627389 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627528 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627690 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.627851 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628001 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628151 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628299 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628437 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628627 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628776 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.628925 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629064 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629212 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629353 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629491 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629628 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629776 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.629916 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630062 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630208 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630370 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630535 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630685 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630834 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.630982 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631157 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631298 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631454 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631593 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631731 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.631870 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632008 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632146 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632303 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632472 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632620 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632759 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.632899 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633049 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633196 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633336 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633475 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633640 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633787 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.633968 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.634637 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.634835 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.634980 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.635147 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.635305 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.635467 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.635615 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.635850 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636018 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636165 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636350 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636530 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636676 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636823 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.636979 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637120 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637302 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637459 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637624 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637780 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.637955 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638102 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638241 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638428 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638571 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638717 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.638870 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639033 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639181 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639327 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639483 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639623 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639770 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.639921 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640060 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640199 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640354 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640538 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640684 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640844 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.640984 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641131 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641280 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641430 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641570 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641719 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.641859 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642036 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642177 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642316 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642454 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642592 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642748 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.642963 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643105 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643252 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643393 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643532 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643670 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643849 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.643996 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644135 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644272 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644440 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644624 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644776 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.644915 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645060 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645199 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645377 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645533 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645683 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.645831 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646004 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646150 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646297 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646443 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646602 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646743 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.646883 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647022 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647162 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647308 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647457 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647598 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647737 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.647875 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648039 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648192 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648347 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648702 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648842 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.648981 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649133 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649273 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649412 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649557 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649697 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.649874 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.650127 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.650442 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.650593 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.650745 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.650884 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651046 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651202 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651352 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651492 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651631 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651777 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.651918 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652065 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652205 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652343 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652554 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.652864 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653014 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653154 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653302 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653443 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653583 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653735 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.653889 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654036 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654176 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654322 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654472 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654621 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654761 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.654914 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655063 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655202 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655340 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655488 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655629 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655768 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.655907 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656070 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656226 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656385 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656593 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656744 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.656883 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657022 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657170 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657310 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657449 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657587 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657726 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.657864 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658012 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658153 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658303 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658588 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658737 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.658884 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.659048 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.659195 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.659644 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.659800 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.659951 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660093 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660233 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660372 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660560 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660705 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.660858 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661005 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661145 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661291 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661438 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661578 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661578 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661858 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.661858 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662128 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662277 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662430 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662578 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662719 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.662856 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663002 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663141 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663290 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663430 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663568 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663706 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663845 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.663983 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664140 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664280 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664419 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664600 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664740 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.664879 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.665028 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.665168 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.665824 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666057 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666276 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666430 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666585 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666585 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.666866 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667006 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667152 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667304 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667444 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667584 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667721 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667860 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.667997 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668284 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668422 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668602 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668746 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.668885 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669103 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669245 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669384 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669522 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669670 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669808 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.669956 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670104 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670244 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670391 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670549 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670699 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670847 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.670994 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671140 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671286 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671432 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671580 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671860 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.671999 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672146 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672489 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672637 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672788 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.672928 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673067 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673205 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673361 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673501 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673639 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673778 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.673917 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674056 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674212 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674352 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674531 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674670 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674810 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.674962 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675103 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675388 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675526 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675665 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675811 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.675960 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676108 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676248 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676419 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676581 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676732 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.676880 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677021 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677160 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677298 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677436 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677587 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677736 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.677875 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678025 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678164 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678311 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678595 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678737 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.678875 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679014 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679166 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679306 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679453 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679621 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679768 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.679925 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680075 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680214 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680353 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680608 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680756 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.680919 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.681212 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.681363 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.681503 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.681643 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.681926 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682091 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682234 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682372 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682519 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682659 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682831 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.682986 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683134 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683275 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683414 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683568 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683715 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.683864 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684015 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684154 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684294 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684433 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684634 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.684797 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685000 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685146 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685349 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685500 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685649 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.685789 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686011 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686167 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686308 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686455 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686603 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686743 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.686889 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687037 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687199 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687353 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687507 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687647 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687786 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.687924 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688147 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688291 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688465 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688612 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688792 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.688938 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689115 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689274 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689414 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689552 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689691 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689830 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.689992 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690285 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690424 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690704 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690844 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.690995 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691135 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691274 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691447 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691616 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691766 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.691923 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692062 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692221 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692472 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692632 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692778 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.692924 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693069 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693226 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693437 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693591 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693739 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.693885 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694052 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694199 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694352 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694498 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694645 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694791 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.694946 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695093 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695238 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695537 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695683 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.695849 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.696004 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.696160 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.696307 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.696474 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.697191 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.697406 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.697558 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.697704 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.697850 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698003 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698158 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698313 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698471 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698618 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698765 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.698912 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699072 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699230 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699377 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699531 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699677 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699822 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.699979 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700126 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700279 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700436 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700631 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700789 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.700945 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701094 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701240 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701394 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701541 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701699 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701847 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.701993 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702139 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702285 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702442 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702605 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702753 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.702900 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703046 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703193 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703339 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703497 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703644 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703791 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.703945 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704091 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704249 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704410 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704593 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704742 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.704889 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705035 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705195 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705344 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705490 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705637 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705782 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.705928 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706086 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706244 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706391 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706537 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706692 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.706839 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707024 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707177 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707325 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707478 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707625 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707771 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.707962 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708118 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708276 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708431 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708639 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708802 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.708950 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709096 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709261 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709410 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709557 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709711 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.709858 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710004 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710150 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710308 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710455 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710609 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710757 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.710903 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711049 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711203 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711350 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711506 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711653 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711800 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.711946 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.712102 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.712316 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.712494 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.712648 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.712864 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713114 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713114 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713411 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713559 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713706 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713852 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.713998 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714311 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714458 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714604 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714604 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.714883 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.715036 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.715620 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.715785 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.715934 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716080 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716227 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716413 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716586 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716758 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.716906 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717060 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717214 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717370 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717517 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717663 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717820 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.717967 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718113 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718268 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718415 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718572 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718717 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.718864 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719023 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719178 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719335 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719490 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719636 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719792 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.719954 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720103 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720249 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720394 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720559 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720660 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720767 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720855 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.720939 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721021 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721021 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721168 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721330 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721439 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721643 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721744 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.721954 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722126 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722267 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722360 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722576 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722740 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.722887 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723045 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723227 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723403 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723564 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723719 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.723885 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724040 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724186 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724339 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724521 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724673 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724832 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.724979 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725126 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725280 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725426 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725573 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725727 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.725891 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726038 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726185 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726330 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726488 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726635 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726780 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.726932 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.727086 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.727240 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.727395 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.727637 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.727835 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.728609 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.728778 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.728925 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729083 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729231 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729389 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729537 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729689 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.729835 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730033 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730191 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730347 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730514 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730720 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.730875 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731029 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731176 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731320 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731475 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731621 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731780 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.731927 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732073 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732228 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732373 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732564 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732722 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732849 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.732951 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733034 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733115 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733313 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733405 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733622 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733891 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.733991 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734237 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734336 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734551 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734641 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734868 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.734964 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735179 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735277 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735487 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735575 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735790 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.735883 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736116 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736309 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736423 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736651 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736741 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.736984 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737082 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737313 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737401 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737637 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737733 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.737938 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738034 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738249 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738337 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738558 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738645 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738860 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.738955 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739163 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739251 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739464 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739549 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739768 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.739856 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740067 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740155 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740373 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740487 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740707 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.740797 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741006 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741100 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741310 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741396 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741615 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741704 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.741922 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742142 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742231 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742484 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742574 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742829 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.742928 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.743114 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.743202 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.743419 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.744137 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.744480 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.744590 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.744782 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745009 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745112 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745338 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745428 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745646 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745757 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.745953 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746052 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746268 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746357 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746575 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746663 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746878 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.746979 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747179 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747268 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747493 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747580 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747800 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.747891 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.748102 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.748197 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.748408 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.748517 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.748737 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749059 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749360 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749447 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749662 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749760 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.749963 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750059 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750272 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750369 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750572 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750661 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750872 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.750960 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751174 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751271 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751474 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751572 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751780 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.751877 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752080 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752168 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752385 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752495 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752711 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.752798 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753019 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753118 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753317 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753408 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753620 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753707 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.753930 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754026 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754240 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754323 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754552 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754639 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754853 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.754948 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755161 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755247 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755462 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755549 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755773 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.755869 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756077 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756163 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756384 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756502 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756752 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.756850 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757065 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757152 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757386 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757599 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757702 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.757929 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758024 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758245 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758332 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758576 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758681 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758888 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.758978 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.759742 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.759926 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.760250 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.760346 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.760592 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.760686 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.760957 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761045 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761269 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761358 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761579 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761667 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.761892 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762034 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762200 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762289 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762508 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762595 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762815 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.762902 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763122 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763212 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763430 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763517 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763735 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.763831 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764041 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764128 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764348 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764430 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764680 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764786 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.764987 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765076 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765298 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765394 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765622 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765722 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.765928 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766023 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766237 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766331 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766548 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766637 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766856 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.766949 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767158 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767244 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767459 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767545 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767761 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.767848 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768068 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768156 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768369 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768574 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768699 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.768797 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769003 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769398 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769601 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769716 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.769903 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770029 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770205 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770346 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770508 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770665 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770811 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.770973 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771113 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771291 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771421 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771609 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771725 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.771919 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772029 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772236 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772324 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772568 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772673 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.772983 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773232 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773330 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773556 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773654 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773869 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.773972 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774168 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774255 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774470 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774571 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774848 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.774934 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.775162 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.775425 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.775516 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.775759 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.775856 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776070 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776156 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776374 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776498 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776705 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.776794 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777013 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777100 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777317 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777413 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777627 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777724 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.777926 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778015 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778227 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778325 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778532 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778621 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778831 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.778918 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779131 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779232 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779431 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779518 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779729 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.779823 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780028 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780118 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780328 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780415 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780659 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780761 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.780962 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781050 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781261 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781349 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781559 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781646 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781860 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.781950 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782157 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782252 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782484 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782580 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782797 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.782883 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783111 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783198 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783428 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783541 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783731 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.783818 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784050 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784137 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784356 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784484 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784701 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.784790 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785019 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785106 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785327 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785423 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785633 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785720 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.785960 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786047 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786266 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786354 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786573 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786660 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786881 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.786967 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.787186 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.787274 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.787427 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:02:53.787521 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.787788 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.788112 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.788436 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.788761 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.789080 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.789394 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.789709 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.790020 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.790347 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.790895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.791434 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.791744 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.792060 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.792371 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.792710 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.793025 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.793340 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.793663 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.793986 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.794293 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.794617 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.794940 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.795286 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.795596 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.795935 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.796258 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.796597 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.796909 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.797211 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:02:53.797459 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:02:53.847884 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Registered counter for database nova_api May 27 15:02:53.859180 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO dbcounter [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Registered counter for database nova_api May 27 15:02:53.870038 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.876722 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:53.878793 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_db.sqlalchemy.engines [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.885674 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writer thread running {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:53.935232 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.context [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5764852-9660-42e1-b8ea-3e2314bb2d69(cell1) {{(pid=103219) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:02:53.939369 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.940957 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.941741 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.943145 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.context [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5764852-9660-42e1-b8ea-3e2314bb2d69(cell1) {{(pid=103220) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:02:53.943694 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.945689 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Registered counter for database nova_cell0 May 27 15:02:53.947430 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_concurrency.lockutils [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.949029 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_concurrency.lockutils [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.949747 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Registered counter for database nova_cell1 May 27 15:02:53.949856 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_concurrency.lockutils [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.951759 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_concurrency.lockutils [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.953733 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO dbcounter [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Registered counter for database nova_cell0 May 27 15:02:53.956971 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.957828 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO dbcounter [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Registered counter for database nova_cell1 May 27 15:02:53.959279 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.965392 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:53.965834 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_db.sqlalchemy.engines [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.967911 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:53.969656 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_db.sqlalchemy.engines [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:53.972075 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writer thread running {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:54.115854 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writer thread running {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:54.116064 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO dbcounter [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Registered counter for database nova_cell0 May 27 15:02:54.124784 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_db.sqlalchemy.engines [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:54.126731 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO dbcounter [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Registered counter for database nova_cell0 May 27 15:02:54.129248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writer thread running {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:54.135995 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG oslo_db.sqlalchemy.engines [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:02:54.140750 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writer thread running {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:02:54.471229 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:02:54.475892 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: WARNING keystonemiddleware.auth_token [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:02:54.478998 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:02:54.488123 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: WARNING keystonemiddleware.auth_token [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:02:54.823337 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:02:54.829314 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: WARNING keystonemiddleware.auth_token [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:02:54.834677 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5621278d09c0 pid: 103219 (default app) May 27 15:02:54.836771 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:54.838676 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002498 May 27 15:02:54.839092 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Fri May 27 15:02:54 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:54.862680 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: WARNING keystonemiddleware.auth_token [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:02:54.872308 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: WARNING keystonemiddleware.auth_token [None req-1a3c3541-80e5-45fc-8fc8-5c444a0d01a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:02:54.880517 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5621278d09c0 pid: 103220 (default app) May 27 15:04:13.714622 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:13.715632 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 27 15:04:13.716185 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:13.733092 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_api:SELECT=3 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:13.734759 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_cell0:SELECT=3 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:13.735745 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_cell1:SELECT=3 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:13.736730 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:14.174417 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-5f1ad756-e862-4c24-b876-c0381d794d77 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:14.203890 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-5f1ad756-e862-4c24-b876-c0381d794d77 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480553 May 27 15:04:14.215440 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:16.499659 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:16.501608 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5a29caaf-a446-42af-9657-29f9da74a0bb None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002342 May 27 15:04:16.502521 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:16.566313 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-2fd69a75-55aa-4b34-a19b-2c3549ae93ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:16.586789 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:04:16.586789 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: warnings.warn(msg) May 27 15:04:16.614624 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-2fd69a75-55aa-4b34-a19b-2c3549ae93ff admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105422 May 27 15:04:16.615179 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:16.630012 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:16.631281 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell0:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:16.632355 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell1:SELECT=3 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:16.633831 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:16.846660 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-fe886956-1be1-4a4c-adb2-ef7ac80fc630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:16.849261 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:04:16.849261 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:04:16.915654 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-fe886956-1be1-4a4c-adb2-ef7ac80fc630 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291476 May 27 15:04:16.916436 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 15:04:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:19.206474 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-2fd69a75-55aa-4b34-a19b-2c3549ae93ff admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:19.207546 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-2fd69a75-55aa-4b34-a19b-2c3549ae93ff admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 27 15:04:19.208394 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:19.315752 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-201528d5-452f-4dc2-aa9f-52a0a31392df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:19.334306 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:04:19.334306 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:04:19.354137 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-201528d5-452f-4dc2-aa9f-52a0a31392df admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139449 May 27 15:04:19.354694 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:19.366706 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-bf62b475-2290-41e0-8c5d-be1e2f14fb6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:19.368247 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:04:19.368247 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: warnings.warn(msg) May 27 15:04:19.401055 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-bf62b475-2290-41e0-8c5d-be1e2f14fb6e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038259 May 27 15:04:19.401651 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 15:04:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:21.711717 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-201528d5-452f-4dc2-aa9f-52a0a31392df admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:21.717944 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-201528d5-452f-4dc2-aa9f-52a0a31392df admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007273 May 27 15:04:21.728792 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:21.787735 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-b2c866f8-b5b9-4bc7-9981-953ac91f41a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:21.810158 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-b2c866f8-b5b9-4bc7-9981-953ac91f41a0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085328 May 27 15:04:21.817173 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:21.824288 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-3177af58-fc69-4f6a-a0d9-ccd77fed5d9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:21.857555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-3177af58-fc69-4f6a-a0d9-ccd77fed5d9b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037085 May 27 15:04:21.864493 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 15:04:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:24.199775 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-b2c866f8-b5b9-4bc7-9981-953ac91f41a0 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:24.200872 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-b2c866f8-b5b9-4bc7-9981-953ac91f41a0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 27 15:04:24.201289 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:24.264721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d819d276-76d0-4eb2-8ff7-4527d48a7df5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:24.284160 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d819d276-76d0-4eb2-8ff7-4527d48a7df5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075991 May 27 15:04:24.285074 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:04:24.298267 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-7ab6680f-11aa-44e6-83f3-c34ccdc54228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:24.325812 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-7ab6680f-11aa-44e6-83f3-c34ccdc54228 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032600 May 27 15:04:24.326400 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 15:04:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:26.605587 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-d819d276-76d0-4eb2-8ff7-4527d48a7df5 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:26.606743 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-d819d276-76d0-4eb2-8ff7-4527d48a7df5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 May 27 15:04:26.607143 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:26.677620 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:26.696532 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080482 May 27 15:04:26.697058 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:26.709201 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b8764f8f-3995-4123-a6b9-316892f8f95b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:26.732833 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-b8764f8f-3995-4123-a6b9-316892f8f95b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027400 May 27 15:04:26.733403 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 15:04:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:04:29.074172 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.075196 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 27 15:04:29.075610 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:29.146663 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-09db39b4-0b4f-4c7c-a997-a06c4b2ba063 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.171315 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-09db39b4-0b4f-4c7c-a997-a06c4b2ba063 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088958 May 27 15:04:29.171865 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:31.472294 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:31.473368 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-e43f9e01-1d6c-49c0-82b1-867228514064 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 May 27 15:04:31.473786 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:31.533724 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-0da2fcdd-f47f-48fd-a75e-042a6696d276 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:31.551467 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-0da2fcdd-f47f-48fd-a75e-042a6696d276 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070908 May 27 15:04:31.552038 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:31.565072 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-b04f924c-89c6-47b9-87a7-02b2655665c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:31.589124 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-b04f924c-89c6-47b9-87a7-02b2655665c3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027847 May 27 15:04:31.589722 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 15:04:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:33.998125 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-0da2fcdd-f47f-48fd-a75e-042a6696d276 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:33.999139 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-0da2fcdd-f47f-48fd-a75e-042a6696d276 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 27 15:04:33.999539 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:34.067925 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-551760be-a153-47dc-9d0a-11d8ec3a723a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "ram": 2048, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:34.092172 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-551760be-a153-47dc-9d0a-11d8ec3a723a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084616 May 27 15:04:34.092937 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:34.107348 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b25c7d10-9f0d-4a63-b6b3-71710686a243 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:34.131524 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-b25c7d10-9f0d-4a63-b6b3-71710686a243 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027977 May 27 15:04:34.132223 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 15:04:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:36.477775 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-551760be-a153-47dc-9d0a-11d8ec3a723a admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:36.478785 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-551760be-a153-47dc-9d0a-11d8ec3a723a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 May 27 15:04:36.479180 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:36.538986 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-e988d8ff-da7e-4589-9e31-2a8a50b35a19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "vcpus": 2}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:36.557962 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-e988d8ff-da7e-4589-9e31-2a8a50b35a19 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072686 May 27 15:04:36.558513 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:36.571098 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-d5236653-21b7-48ae-bd79-fed60f0277fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:36.593469 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-d5236653-21b7-48ae-bd79-fed60f0277fc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026942 May 27 15:04:36.594047 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 15:04:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:04:38.855833 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-e988d8ff-da7e-4589-9e31-2a8a50b35a19 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:38.856934 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-e988d8ff-da7e-4589-9e31-2a8a50b35a19 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 27 15:04:38.857953 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:38.915444 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-3c15cdb9-4375-471b-b2ad-51188b8957f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "swap": 0, "ram": 8192, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:38.934486 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-3c15cdb9-4375-471b-b2ad-51188b8957f2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069315 May 27 15:04:38.935046 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:38.946992 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b7f8e0a2-799c-43aa-b760-5e24811ef7e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:38.970694 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-b7f8e0a2-799c-43aa-b760-5e24811ef7e6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027402 May 27 15:04:38.978175 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 15:04:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:41.268399 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-3c15cdb9-4375-471b-b2ad-51188b8957f2 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:41.269436 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-3c15cdb9-4375-471b-b2ad-51188b8957f2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 27 15:04:41.269837 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:41.332172 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:41.353470 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076679 May 27 15:04:41.354126 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 15:04:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:41.368221 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-aa547d8a-e1a8-4f6d-9d0c-d76c2d0066a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:41.399743 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-aa547d8a-e1a8-4f6d-9d0c-d76c2d0066a3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035972 May 27 15:04:41.400328 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 15:04:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:06.027697 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:06.028774 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 27 15:05:06.029224 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:06.039902 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:06.089340 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6bbac17d-a150-40f6-ab3e-53b186a4943d admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:06.106496 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6bbac17d-a150-40f6-ab3e-53b186a4943d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071263 May 27 15:05:06.107026 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 15:05:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:07.106162 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.107159 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-0d51e302-95ac-46b1-a663-246818937c3c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 27 15:05:07.107559 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:07.318458 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-f395cbee-a037-4295-b61c-53cbbf447141 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.324124 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.wsgi [None req-f395cbee-a037-4295-b61c-53cbbf447141 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-f395cbee-a037-4295-b61c-53cbbf447141 admin admin] Request method failure captured: May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept: application/json May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept-Encoding: gzip, deflate May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Connection: keep-alive May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Content-Length: 0 May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Host: 10.222.0.41 May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-Api-Version: compute 2.90 May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-System-Scope: None May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: User-Agent: python-novaclient May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Auth-Token: gAAAAABikOijmABWqkLEYasGcdcqxW2oW7sZ0p4p43-co-41-H5cix14ivkZ87c4HVztjs4ms9J0O98L8ZZcJMuZ1_x72ljcVAEkFN5wrdmqUvLF1NNKrsZlCuTJuoo9VpGAmNxl5f3OLQjagIZ-yEe_CSqrlV8X-qQ6vo9dUyYRxYkHGKFcR0E May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Id: None May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Name: None May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Identity-Status: Confirmed May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Is-Admin-Project: True May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Id: default May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Name: Default May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Name: admin May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Role: reader,member,admin May 27 15:05:07.327406 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Roles: reader,member,admin May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant: admin May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Name: admin May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User: admin May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Id: default May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Name: Default May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Name: admin May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: method: > May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: exception: Flavor 42 could not be found. May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: action_args: {'id': '42'} May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:07.329206 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.330210 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:07.331390 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-f395cbee-a037-4295-b61c-53cbbf447141 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:07.332545 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-f395cbee-a037-4295-b61c-53cbbf447141 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062408 May 27 15:05:07.332545 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:07.339685 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-fc108ef7-1ae8-4eb9-93dd-6dfc462da2c8 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.342922 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:07.362700 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-fc108ef7-1ae8-4eb9-93dd-6dfc462da2c8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027673 May 27 15:05:07.363246 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:07.373108 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-258d700e-005b-4a62-8409-8195acf36744 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.394386 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-258d700e-005b-4a62-8409-8195acf36744 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024801 May 27 15:05:07.394951 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:07.404835 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-ffd98cc7-fbbe-4c44-999e-1c806f41ab44 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.411133 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-ffd98cc7-fbbe-4c44-999e-1c806f41ab44 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-ffd98cc7-fbbe-4c44-999e-1c806f41ab44 admin admin] Request method failure captured: May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept: application/json May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Connection: keep-alive May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Content-Length: 0 May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Host: 10.222.0.41 May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABikOijmABWqkLEYasGcdcqxW2oW7sZ0p4p43-co-41-H5cix14ivkZ87c4HVztjs4ms9J0O98L8ZZcJMuZ1_x72ljcVAEkFN5wrdmqUvLF1NNKrsZlCuTJuoo9VpGAmNxl5f3OLQjagIZ-yEe_CSqrlV8X-qQ6vo9dUyYRxYkHGKFcR0E May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Id: None May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Name: None May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Name: admin May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Role: reader,member,admin May 27 15:05:07.414977 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Roles: reader,member,admin May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant: admin May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User: admin May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Name: admin May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: method: > May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: exception: Flavor 42 could not be found. May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: action_args: {'id': '42'} May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:07.416597 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.417466 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:07.418555 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-ffd98cc7-fbbe-4c44-999e-1c806f41ab44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:07.419569 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-ffd98cc7-fbbe-4c44-999e-1c806f41ab44 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015080 May 27 15:05:07.419569 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:08.286662 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-258d700e-005b-4a62-8409-8195acf36744 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.287664 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-258d700e-005b-4a62-8409-8195acf36744 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 27 15:05:08.288058 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:05:08.481491 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b2081477-2012-4ebd-9c55-331ebbdc800f admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.486765 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-b2081477-2012-4ebd-9c55-331ebbdc800f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b2081477-2012-4ebd-9c55-331ebbdc800f admin admin] Request method failure captured: May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept: application/json May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Connection: keep-alive May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Content-Length: 0 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Host: 10.222.0.41 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABikOik-M0e0CR9hQTB2ScqajxO-UgAteMuVPildvZRgolKou51zFnG_1wKe9BwBpJ88x3t-r5GE11QX-Cg1Mz7_AysSTCTRJ00P0Aa3Ai3RGzx2voSeAZ037ZxKw3_sm1D5geH7ZEFj6QfdYqHrYLoqFdupXgPE2ghFnxfUueyGmSu8d4 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Id: None May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Name: None May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Name: admin May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Role: reader,member,admin May 27 15:05:08.488248 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Roles: reader,member,admin May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant: admin May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User: admin May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Name: admin May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: method: > May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: exception: Flavor 84 could not be found. May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: action_args: {'id': '84'} May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:08.489721 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:08.490576 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:08.492090 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-b2081477-2012-4ebd-9c55-331ebbdc800f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:08.493153 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-b2081477-2012-4ebd-9c55-331ebbdc800f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062932 May 27 15:05:08.493153 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:08.500386 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-66567a93-acfd-4f74-afd4-76dbc2d28163 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.516214 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-66567a93-acfd-4f74-afd4-76dbc2d28163 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020131 May 27 15:05:08.516783 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:08.526800 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5f83df5f-566d-4a66-8a40-5d9655629fba admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.540628 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5f83df5f-566d-4a66-8a40-5d9655629fba admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017995 May 27 15:05:08.541178 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:08.550249 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-fc5d284c-c305-404b-870e-52fd45096edd admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.555758 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.wsgi [None req-fc5d284c-c305-404b-870e-52fd45096edd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-fc5d284c-c305-404b-870e-52fd45096edd admin admin] Request method failure captured: May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept: application/json May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept-Encoding: gzip, deflate May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Connection: keep-alive May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Content-Length: 0 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Host: 10.222.0.41 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-Api-Version: compute 2.90 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-System-Scope: None May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: User-Agent: python-novaclient May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Auth-Token: gAAAAABikOik-M0e0CR9hQTB2ScqajxO-UgAteMuVPildvZRgolKou51zFnG_1wKe9BwBpJ88x3t-r5GE11QX-Cg1Mz7_AysSTCTRJ00P0Aa3Ai3RGzx2voSeAZ037ZxKw3_sm1D5geH7ZEFj6QfdYqHrYLoqFdupXgPE2ghFnxfUueyGmSu8d4 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Id: None May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Name: None May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Identity-Status: Confirmed May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Is-Admin-Project: True May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Id: default May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Name: Default May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Name: admin May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Role: reader,member,admin May 27 15:05:08.557301 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Roles: reader,member,admin May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant: admin May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Name: admin May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User: admin May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Id: default May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Name: Default May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Name: admin May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: method: > May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: exception: Flavor 84 could not be found. May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: action_args: {'id': '84'} May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:08.558888 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:08.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:08.560895 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-fc5d284c-c305-404b-870e-52fd45096edd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:08.561940 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-fc5d284c-c305-404b-870e-52fd45096edd admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011947 May 27 15:05:08.561940 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:09.435903 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5f83df5f-566d-4a66-8a40-5d9655629fba admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.436939 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5f83df5f-566d-4a66-8a40-5d9655629fba admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 27 15:05:09.437336 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:09.626825 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-7be141e4-907a-4ecc-ab2c-6aa130730f4a admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.633087 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.wsgi [None req-7be141e4-907a-4ecc-ab2c-6aa130730f4a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-7be141e4-907a-4ecc-ab2c-6aa130730f4a admin admin] Request method failure captured: May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept: application/json May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Accept-Encoding: gzip, deflate May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Connection: keep-alive May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Content-Length: 0 May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Host: 10.222.0.41 May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-Api-Version: compute 2.90 May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Openstack-System-Scope: None May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: User-Agent: python-novaclient May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Auth-Token: gAAAAABikOilmQ6noXBNNzM68GsYhGJH2f7Ouf4woA7Y6j0LYHpBJjTS87etX9oq4umgSeQzBxPVXFPoBlaBua6TqpW9r8N6TX_Y8kAQwKgwjJzXXTADXZC_RZzdS1zgmrEuEHwsvaFWorca_Tt5MzRRM8c68qCha9JsEmKyOpuY3TRcSCl__rs May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Id: None May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Domain-Name: None May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Identity-Status: Confirmed May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Is-Admin-Project: True May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Id: default May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Domain-Name: Default May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Project-Name: admin May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Role: reader,member,admin May 27 15:05:09.634565 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Roles: reader,member,admin May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant: admin May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-Tenant-Name: admin May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User: admin May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Id: default May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Domain-Name: Default May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: X-User-Name: admin May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: method: > May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: exception: Flavor 451 could not be found. May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: action_args: {'id': '451'} May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:09.636159 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.637018 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: ERROR nova.api.openstack.wsgi May 27 15:05:09.638090 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-7be141e4-907a-4ecc-ab2c-6aa130730f4a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:09.639073 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-7be141e4-907a-4ecc-ab2c-6aa130730f4a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060447 May 27 15:05:09.639073 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:09.645857 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-5e5fefbd-9fc4-4cda-90ce-753f31dc50f0 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.661374 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-5e5fefbd-9fc4-4cda-90ce-753f31dc50f0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019072 May 27 15:05:09.661900 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:09.671826 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.685119 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016808 May 27 15:05:09.685635 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:09.694602 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-1505e2c6-6768-4376-a759-c7cb555ddaa6 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.699841 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.wsgi [None req-1505e2c6-6768-4376-a759-c7cb555ddaa6 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-1505e2c6-6768-4376-a759-c7cb555ddaa6 admin admin] Request method failure captured: May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept: application/json May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Accept-Encoding: gzip, deflate May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Connection: keep-alive May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Content-Length: 0 May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Host: 10.222.0.41 May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-Api-Version: compute 2.90 May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Openstack-System-Scope: None May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: User-Agent: python-novaclient May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Auth-Token: gAAAAABikOilmQ6noXBNNzM68GsYhGJH2f7Ouf4woA7Y6j0LYHpBJjTS87etX9oq4umgSeQzBxPVXFPoBlaBua6TqpW9r8N6TX_Y8kAQwKgwjJzXXTADXZC_RZzdS1zgmrEuEHwsvaFWorca_Tt5MzRRM8c68qCha9JsEmKyOpuY3TRcSCl__rs May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Id: None May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Domain-Name: None May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Identity-Status: Confirmed May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Is-Admin-Project: True May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Id: default May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Domain-Name: Default May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Project-Name: admin May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Role: reader,member,admin May 27 15:05:09.701451 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Roles: reader,member,admin May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1ab0327c3107460fb9252bf46e1b56cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant: admin May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Id: 1ab0327c3107460fb9252bf46e1b56cc May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-Tenant-Name: admin May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User: admin May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Id: default May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Domain-Name: Default May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Id: bcba1f2f592c4d6cbf88e82920040619 May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: X-User-Name: admin May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: method: > May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: exception: Flavor 451 could not be found. May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: action_args: {'id': '451'} May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:09.703057 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.704285 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: ERROR nova.api.openstack.wsgi May 27 15:05:09.705449 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-1505e2c6-6768-4376-a759-c7cb555ddaa6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:09.706585 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-1505e2c6-6768-4376-a759-c7cb555ddaa6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011742 May 27 15:05:09.706585 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:10.589150 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:10.590154 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 27 15:05:10.590546 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:10.779875 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-523957cb-5a35-4688-b3fa-b4c20d98dc63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:10.798399 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-523957cb-5a35-4688-b3fa-b4c20d98dc63 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069624 May 27 15:05:10.798941 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 15:05:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:05:11.681718 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:11.682752 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 27 15:05:11.683181 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:11.873572 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-696b4e1b-9e50-4066-91cc-e0e52b5081e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:11.890588 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-696b4e1b-9e50-4066-91cc-e0e52b5081e7 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069097 May 27 15:05:11.891167 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 15:05:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:05:12.771147 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:12.772150 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 27 15:05:12.772607 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:12.963653 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-76cf2e28-2364-4965-a52e-b7f189ab34ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:12.980509 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-76cf2e28-2364-4965-a52e-b7f189ab34ba admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069182 May 27 15:05:12.980984 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 15:05:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:05:13.857881 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:13.858887 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 27 15:05:13.859289 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:05:14.049755 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-41773537-7dd9-4b24-9b00-98105b86dde5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:14.067706 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-41773537-7dd9-4b24-9b00-98105b86dde5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069589 May 27 15:05:14.068203 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 15:05:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:05:14.932801 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:14.933795 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 27 15:05:14.934185 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:15.125311 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-94dff357-9a57-4ee9-a07d-96c97592f91e admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:15.144806 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-94dff357-9a57-4ee9-a07d-96c97592f91e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073510 May 27 15:05:15.145368 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Fri May 27 15:05:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:17.633710 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.634709 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-6b704143-1915-430d-afa0-278af6e337f6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 27 15:06:17.635107 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:17.642601 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:17.694916 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-fc9d79de-97d6-46d7-981a-f5971bbcfad2 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.714486 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-fc9d79de-97d6-46d7-981a-f5971bbcfad2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073288 May 27 15:06:17.715064 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:17.736144 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG dbcounter [-] [103220] Writing DB stats nova_api:SELECT=14 {{(pid=103220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:17.740028 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-c711e3d9-ee2f-4e00-9de5-99fa54e5ceac admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.747859 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-c711e3d9-ee2f-4e00-9de5-99fa54e5ceac admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013255 May 27 15:06:17.748368 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:17.760261 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-8956e519-296f-4519-ad1c-7fe69c315ec6 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.767740 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-8956e519-296f-4519-ad1c-7fe69c315ec6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011711 May 27 15:06:17.768250 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:17.779959 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.787461 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010937 May 27 15:06:17.788035 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:17.800320 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-966be9e8-d2df-4644-a8c6-ca43492ae4ba admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.808280 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-966be9e8-d2df-4644-a8c6-ca43492ae4ba admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011495 May 27 15:06:17.808828 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:55.172279 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:55.173345 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 27 15:09:55.173746 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:55.331374 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=6 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:55.447569 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:55.448793 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:09:55.448793 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:09:55.449984 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.450421 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.451748 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.452170 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.487118 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-c6f1a8b2-cc51-47f3-9e71-f7e9240e77f8 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157210 May 27 15:09:55.487694 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:09:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:56.370042 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:56.371039 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 27 15:09:56.371435 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:56.563229 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:56.564399 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:09:56.564399 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:09:56.565640 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.566152 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:56.566937 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.567363 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:56.587072 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-23de15e7-7169-492a-b717-82034252a368 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075304 May 27 15:09:56.587556 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:09:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:10:07.889896 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:07.890933 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 27 15:10:07.891331 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:08.035849 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell0:SELECT=4 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:08.036593 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_cell1:SELECT=4 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:08.037236 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG dbcounter [-] [103219] Writing DB stats nova_api:SELECT=8 {{(pid=103219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:08.086930 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:08.088094 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:10:08.088094 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:10:08.089320 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:08.089763 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:08.090546 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:08.091144 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:08.116392 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-96ad92d3-42b8-4204-b4a3-12ea06ef6f5e admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084950 May 27 15:10:08.116904 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:10:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:08.995171 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: DEBUG nova.api.openstack.wsgi [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] Calling method '>' {{(pid=103220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:08.996163 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: INFO nova.api.openstack.requestlog [None req-749dd61b-a5a8-45a2-847a-9925145afab6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 27 15:10:08.996647 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: [pid: 103220|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 15:10:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:09.189986 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG nova.api.openstack.wsgi [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] Calling method '>' {{(pid=103219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:09.191145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:10:09.191145 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: warnings.warn(msg) May 27 15:10:09.192311 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.192785 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.193569 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.193992 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: DEBUG oslo_concurrency.lockutils [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.215183 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: INFO nova.api.openstack.requestlog [None req-16f97a75-9e07-49c6-9de9-5f302d1d6be1 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079775 May 27 15:10:09.216224 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: [pid: 103219|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 15:10:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:07.199281 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: Fri May 27 15:11:07 2022 - graceful shutdown triggered... May 27 15:11:07.199418 dv-cinder-842541-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 15:11:07.200523 dv-cinder-842541-3-iscsi devstack@n-api.service[103219]: Gracefully killing worker 1 (pid: 103219)... May 27 15:11:07.200989 dv-cinder-842541-3-iscsi devstack@n-api.service[103220]: Gracefully killing worker 2 (pid: 103220)... May 27 15:11:08.201613 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: worker 1 buried after 1 seconds May 27 15:11:08.201613 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: worker 2 buried after 1 seconds May 27 15:11:08.201613 dv-cinder-842541-3-iscsi devstack@n-api.service[103218]: goodbye to uWSGI. May 27 15:11:08.203146 dv-cinder-842541-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 15:11:08.203708 dv-cinder-842541-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 15:11:08.206466 dv-cinder-842541-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 15:11:08.220158 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 15:11:08 2022] *** May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: nodename: dv-cinder-842541-3-iscsi May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: machine: x86_64 May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: clock source: unix May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: pcre jit disabled May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: detected number of CPU cores: 4 May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: current working directory: / May 27 15:11:08.238642 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: detected binary path: /usr/bin/uwsgi-core May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: your processes number limit is 47680 May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: your memory page size is 4096 bytes May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: detected max file descriptor number: 2048 May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: lock engine: pthread robust mutexes May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: thunder lock: enabled May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 15:11:08.239441 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 15:11:08.284674 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: Python main interpreter initialized at 0x55c76c4cd9c0 May 27 15:11:08.284674 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: python threads support enabled May 27 15:11:08.284674 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: your server socket listen backlog is limited to 100 connections May 27 15:11:08.284674 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: your mercy for graceful operations on workers is 90 seconds May 27 15:11:08.285119 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: mapped 403077 bytes (393 KB) for 2 cores May 27 15:11:08.285119 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: *** Operational MODE: preforking *** May 27 15:11:08.285362 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: *** uWSGI is running in multiple interpreter mode *** May 27 15:11:08.285362 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: spawned uWSGI master process (pid: 117628) May 27 15:11:08.285570 dv-cinder-842541-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 15:11:08.286680 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 1 (pid: 117641, cores: 1) May 27 15:11:08.286680 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 2 (pid: 117642, cores: 1) May 27 15:11:08.286680 dv-cinder-842541-3-iscsi devstack@n-api.service[117628]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 15:11:09.476823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:11:09.477394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:11:10.281124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:11:10.281124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes May 27 15:11:10.281460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:11:10.281460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: from cryptography.utils import int_from_bytes May 27 15:11:10.281642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:11:10.281642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: from cryptography.utils import int_from_bytes May 27 15:11:10.281830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:11:10.281830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: from cryptography.utils import int_from_bytes May 27 15:11:12.711611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:11:12.712932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:11:12.712932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:11:12.712932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:11:12.713193 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:11:12.713573 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.713911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.714240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.714567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.714902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.715240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.715564 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.715931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.716561 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.716830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.717149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.717478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842541-3-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.717802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.718112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.718424 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.718748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.719057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.719378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.719685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.720182 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.720656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.720969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.721282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.721621 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.721940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.722252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.722575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.722884 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.723213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.723526 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.723934 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842541-3-iscsi {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.724248 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.724586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.724906 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.725321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.725636 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.725967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.726272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.726595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.726903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.727230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.727549 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.727870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.728190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.728512 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.728968 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.729413 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.729652 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.729963 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.730270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.730526 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.730837 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.731162 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.731489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.731812 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.732073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.732325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.732675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.732999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.733311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.733622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.733935 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.734267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.734580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.734890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.735202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.735530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.736639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.736639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.736639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.736916 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.737127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.737505 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.737758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.738069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.738427 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.738731 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.739041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.739360 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.739856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.740347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.740687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.741001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.741325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.741656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.741873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:11:12.742358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.742514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:11:12.742671 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.742671 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.742967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:11:12.743128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.743275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:11:12.743432 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.743586 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:11:12.743743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.743908 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.744072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.744751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.744907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.745955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746443 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.746884 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747038 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747199 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747821 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.747977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842541-3-iscsi {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.748135 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.748299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.748538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.748705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.748865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749647 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.749870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750112 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.750884 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751056 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.751918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752222 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.752878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753179 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.753932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754402 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842541-3-iscsi {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754554 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754717 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.754874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755020 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755334 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755777 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.755923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756077 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756223 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756376 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.756900 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757048 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.757985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758593 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758757 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.758912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.759059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.759204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.759358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.759511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.759671 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.759824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.760866 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.761036 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.761189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.761345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.761520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.761520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.761807 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.762051 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.762211 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.762404 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.762571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.762718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.762871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.763023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.763185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.763341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.763508 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.763662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.763810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.763963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.764252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.764493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.764673 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.764828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.764977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.765122 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.765267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.765464 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.765633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.765787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.765940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.766095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.766254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.766400 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.766552 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.766706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.766860 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.767006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.767159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.767315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.767468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.767632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.767884 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.768128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.768294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.768464 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.768464 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.768748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.768748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.769043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.769198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.769344 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.769499 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.769656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.769813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.770035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.770184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.770340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.770485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.770638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.770944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.771118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.771264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.771417 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.771563 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.771715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.771870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.772059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.772279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.772429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.772617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.772774 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.772937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.773097 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.773254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.773401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.773545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.773690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.773690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.773991 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.774143 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.774295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.774442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.774594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.774594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.774900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.775055 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.775201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.775353 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.775498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.775657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.775810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.775977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.776160 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.776350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.776516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.776684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.776840 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.776995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.777191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.777356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.777509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.777668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.777839 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.778065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.778341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.778503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.778664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.778664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.778946 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.779091 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.779247 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.779401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.779555 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.779709 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.779862 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.780023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.780178 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.780347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.780527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.780700 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.780855 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.781163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.781325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.781486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.781643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.781789 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.781934 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.782086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.782264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.782484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.782646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.782793 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.782944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.783090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.783249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.783403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.783548 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.783703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.783849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.784001 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.784156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.784309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.784494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.784647 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.784812 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.784969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.785123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.785277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.785429 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.785576 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.785768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.785928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.786073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.786218 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.786363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.786526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.786672 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.786864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.787013 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.787158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.787311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.787464 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.787618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.787773 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.787959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.788196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.788372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.788632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.788810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.789148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.789316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.789472 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.789625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.789772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.789927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.790081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:11:12.790228 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.790380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.790534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.790689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.790859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.791005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.791446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.791709 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.791926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.791926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.792231 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.792388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.792664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.792826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.792973 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.793133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.793287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.793444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.793772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794004 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794161 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794815 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.794962 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795115 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795277 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795423 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.795741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.796042 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.796211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.796211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.797901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.798057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.798237 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.798473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.798732 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.798971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799135 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.799898 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800548 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.800879 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801812 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.801956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802555 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.802968 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803114 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803259 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803405 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803559 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.803850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804465 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.804951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805390 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805543 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805833 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.805983 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.806149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.806304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.806458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.806611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.807298 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.807492 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.807658 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.807804 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.807999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.808155 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.808301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.808484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.808724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.808883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809475 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.809940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810093 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810247 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.810852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811011 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.811957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812112 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812410 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812640 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812816 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.812816 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813785 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.813938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814091 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814237 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814542 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.814867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815144 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815317 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.815943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.816090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.816809 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.816981 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817417 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.817884 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818032 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818649 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.818890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819197 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819657 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.819829 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820549 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.820869 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821784 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.821940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.822094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.822242 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.822388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.823251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.823512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.823847 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.823997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824288 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824785 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.824949 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825542 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.825853 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.826015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827040 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827361 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827508 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827663 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.827970 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.828129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.828276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.828435 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.828641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.828788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.829961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.830225 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.830377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.830532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.830690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.830845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.831005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.831159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.831319 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.831487 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.831634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832049 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832564 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.832885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833445 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833773 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.833996 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834614 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.834948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835281 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835435 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.835903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836221 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836373 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.836887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837511 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.837823 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.838009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.838169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.838488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.838706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.838871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839915 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.839915 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.840230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.840516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.840699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.840862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.841275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.841432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.841585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.841737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.841920 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.842259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.842413 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.842574 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.842726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.842887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.843933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.844109 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.844277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.844537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.844708 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.844871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845208 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845208 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845823 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.845990 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846831 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.846985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847146 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847297 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.847941 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.848691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.848691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.848998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.849176 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.849434 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.849603 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.849757 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.849917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.850966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851771 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.851931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.852110 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.852437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.852634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.852789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.852950 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.853110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.853264 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.853430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.853633 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.853877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854513 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854678 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.854998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855155 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855317 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855470 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855622 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.855956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856109 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.856960 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.857942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858483 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858645 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858799 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.858952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.859117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.859279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.859458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.859697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.861350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.861537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.861731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.861886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.862048 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.862200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.862534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.862694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.862694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863010 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863173 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863334 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.863830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.864237 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.864400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.864648 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.864992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865642 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.865971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.866124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.866297 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.866534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.866689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.867362 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.867529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.867683 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.867848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868712 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.868882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.869056 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.869753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.869988 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870155 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870317 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870801 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.870956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.871263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.871538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.871711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.871873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.872036 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.872189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.872349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.872741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.872910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873533 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.873862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.874929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875647 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.875972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876470 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876630 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876794 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.876948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877426 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877426 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.877903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.878870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879029 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879029 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879332 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.879977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.880208 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.880385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.880600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.880764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.880925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881086 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881247 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881580 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881827 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.881989 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.882149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.882315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.882468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.883326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.883506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.883662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.883823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.883993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884155 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884572 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.884961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.885785 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.885947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886121 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886441 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886756 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.886908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887061 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.887972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888135 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888803 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.888962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.889144 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.889435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.889617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.889772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.889931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890098 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890362 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.890980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.891140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.891302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.891458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.891610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.891761 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.892023 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.892183 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.892345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.892553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.892712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893040 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.893988 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.894140 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.894302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.894545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.894704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.894870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.895969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.896120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.896290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.896917 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897419 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.897892 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.898995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899146 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.899951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.900103 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.900255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.900544 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.900716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.900871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.901991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.902260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.902432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.902601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.902755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.902924 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.903553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.904291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.904617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.904794 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.904948 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.905911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906248 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.906885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907210 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907378 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.907858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908688 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.908841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909155 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909492 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909652 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.909819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.910133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.910294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.910446 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.910688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.910846 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911162 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911466 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911788 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.911941 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.912093 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.912275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.912567 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.912728 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.912894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913048 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.913836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.914151 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.914311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.914478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.914649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.914873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915760 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.915921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916310 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916642 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.916818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917592 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917753 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.917915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918075 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.918858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.919941 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.920102 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.920262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.920415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.920415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.920853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921812 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.921964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.922116 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.922268 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.922443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.922714 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.922883 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.923049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.923210 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.923530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.923707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.923871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924666 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.924829 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.925738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926191 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926504 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926665 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926665 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.926965 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927120 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.927925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928077 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928391 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928584 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.928889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929817 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.929977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.930148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.930327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.930615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.930776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.930980 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.931145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.931355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.931529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.931692 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.932411 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.932600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.932866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933203 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933203 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.933973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934609 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934761 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.934922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935101 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935635 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935787 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.935787 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.936097 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.936250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.938877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.939655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.939825 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.939992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.940436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.940656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.940905 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.941967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.942121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.942281 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.942433 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.942669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.942843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943581 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.943921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.944252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.944414 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.944633 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.944787 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.944955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.945121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.945276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.945530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.945688 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.945851 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946657 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.946973 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.947141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.947302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.948878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949838 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949990 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.949990 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.950302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.950462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.950615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.950776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951021 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951584 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951584 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.951889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.952049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.952473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.952638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.952792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.952956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.953129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.953386 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.954127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.954445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.954627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.954792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.954954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.955122 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.955286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.955449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.955710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.955878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.956908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957541 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957694 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957846 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.957998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958313 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958474 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.958950 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959581 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959909 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.959909 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.960988 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961838 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961916 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.961996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962379 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962532 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962763 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.962914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963121 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963736 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.963971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964116 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964268 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964425 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.964959 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965121 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965194 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965487 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965571 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.965940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966366 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966702 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966856 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.966998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967156 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967609 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967908 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967987 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.967987 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968695 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.968928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969016 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969089 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969429 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969698 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.969922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970083 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970373 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970547 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970874 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.970947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971018 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971340 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.971977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972470 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972765 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.972971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973053 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973602 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973702 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.973848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974086 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974423 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974735 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974861 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.974958 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.975958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976217 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976402 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.976992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977192 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.977963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.978072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.978178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.978266 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.978362 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.978498 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979153 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979757 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979853 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.979943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980400 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980681 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.980983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981201 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.981514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.982948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984067 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984067 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984067 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.984843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.985273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.985777 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.986105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.986434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.986746 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.987069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.987393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.987707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.988033 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.988347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.988740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.989086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.989472 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.989737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.990043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.990350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.990656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.990972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.991296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.991610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.991916 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.992222 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.992559 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.992870 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.993179 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.993486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.993793 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.994104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.995051 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.995374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.995760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.996070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.996379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.996723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.997038 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.997421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.997732 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.998040 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.998350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.998656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.998989 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.999343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.999645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:12.999970 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.000283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.000631 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.000944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.001267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.001607 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.001928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.002240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.002573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.002885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.003197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.003509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.003821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.004135 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.004470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.004805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.005142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.005453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.005783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.006104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.006429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.006749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.007063 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.007393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.007710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.008023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.008338 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.008685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.009002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.009320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.009641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.010016 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.010348 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.010660 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.010990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.011318 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.011667 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.011985 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.012329 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.012695 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.013009 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.013324 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.013632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:11:13.013876 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:11:13.040066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Registered counter for database nova_api May 27 15:11:13.061993 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.069499 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.074897 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO dbcounter [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Registered counter for database nova_api May 27 15:11:13.094709 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_db.sqlalchemy.engines [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.102002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writer thread running {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.130153 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.context [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5764852-9660-42e1-b8ea-3e2314bb2d69(cell1) {{(pid=117642) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:11:13.134557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.136292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.137170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.139288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.141407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Registered counter for database nova_cell0 May 27 15:11:13.145703 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Registered counter for database nova_cell1 May 27 15:11:13.153314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.156519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.159060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.context [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5764852-9660-42e1-b8ea-3e2314bb2d69(cell1) {{(pid=117641) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:11:13.159425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.163258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.164913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.165729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.168379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.170394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO dbcounter [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Registered counter for database nova_cell0 May 27 15:11:13.174447 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO dbcounter [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Registered counter for database nova_cell1 May 27 15:11:13.181376 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_db.sqlalchemy.engines [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.184282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_db.sqlalchemy.engines [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.189335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writer thread running {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.191942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writer thread running {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.310212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.320110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO dbcounter [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Registered counter for database nova_cell0 May 27 15:11:13.327649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_db.sqlalchemy.engines [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.332323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writer thread running {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.339650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO dbcounter [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Registered counter for database nova_cell0 May 27 15:11:13.346775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_db.sqlalchemy.engines [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:11:13.351159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writer thread running {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:11:13.669276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:11:13.676739 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:11:13.687579 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: WARNING keystonemiddleware.auth_token [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:11:13.695673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: WARNING keystonemiddleware.auth_token [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:11:14.028054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:11:14.034119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: WARNING keystonemiddleware.auth_token [None req-109202da-464a-4b58-ad9d-2ecf838a1fb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:11:14.039388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c76c4cd9c0 pid: 117642 (default app) May 27 15:11:14.040662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: WARNING keystonemiddleware.auth_token [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:11:14.047209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: WARNING keystonemiddleware.auth_token [None req-0d11f448-835d-4feb-927c-e0179f4d793b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:11:14.052531 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c76c4cd9c0 pid: 117641 (default app) May 27 15:11:55.191969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:55.192808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:55.193828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:55.194551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:56.439385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7aba6dfd-cb03-49e3-b7b4-db9b34d69862 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Action: 'create', calling method: .version_select at 0x7fa37474dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1882930067", "metadata": {"Type": "work"}}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:58.993378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7aba6dfd-cb03-49e3-b7b4-db9b34d69862 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.805787 May 27 15:11:58.994826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 15:11:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 15:11:59.320050 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-de6d51ea-e858-474a-87de-b487f551e73c tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Calling method '.version_select at 0x7fa3747155e0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:59.386214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:59.387720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:59.395980 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:59.396751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:00.300741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-de6d51ea-e858-474a-87de-b487f551e73c tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2" status: 200 len: 354 microversion: 2.1 time: 1.296682 May 27 15:12:00.301354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 1/2] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:11:59 2022] GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 => generated 354 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:00.313930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aa38ec24-931f-451e-a51d-927509726710 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Calling method '.version_select at 0x7fa37459db80>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.440389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aa38ec24-931f-451e-a51d-927509726710 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2" status: 200 len: 354 microversion: 2.1 time: 0.130807 May 27 15:12:00.441910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:12:00 2022] GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:00.461739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d4906c0e-fc49-4d8b-a742-9914b9f9f918 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Calling method '.version_select at 0x7fa3745d8c10>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.606977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d4906c0e-fc49-4d8b-a742-9914b9f9f918 tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2" status: 202 len: 0 microversion: 2.1 time: 0.149093 May 27 15:12:00.608624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:12:00 2022] DELETE /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:12:00.616974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ed9f816b-eef7-4d83-ac3d-1b74f0d2070a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Calling method '.version_select at 0x7fa37459ddc0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.739388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ed9f816b-eef7-4d83-ac3d-1b74f0d2070a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2" status: 200 len: 353 microversion: 2.1 time: 0.126390 May 27 15:12:00.740605 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 3/5] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:12:00 2022] GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:01.056354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1474114825", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "networks": [{"uuid": "c2b21ed3-dc9f-458d-a75a-110ba2d09293"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:01.283363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] validate_networks() for [('c2b21ed3-dc9f-458d-a75a-110ba2d09293', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:01.753565 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc6d9d85-1b4c-4fc4-a927-d8bbd39b551a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Calling method '.version_select at 0x7fa3745b5310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.818099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-cc6d9d85-1b4c-4fc4-a927-d8bbd39b551a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] HTTP exception thrown: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc6d9d85-1b4c-4fc4-a927-d8bbd39b551a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Request method failure captured: May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 HTTP/1.1 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOo7sFA3undUZnUiZTLtrHpo-kRGqbUoWzxf5EsEdmMXP9sT0Gq2B1D0kA0ME18VUQAIVO8EutokwHjud8a1RNMTpNssZQLW1hhnni2DpDvB2T1ahmzJfmaqHseXV2ZcivZVkMY2iI2Z0eyr_dWGcO_4Hh0c34LrA5rWr1rRHtRfi0c May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: edcf57a6279243308232f9fbc8c158e2 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesGetTestJSON-556243204 May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:12:01.823250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/edcf57a6279243308232f9fbc8c158e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/edcf57a6279243308232f9fbc8c158e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_edcf57a6279243308232f9fbc8c158e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/edcf57a6279243308232f9fbc8c158e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesGetTestJSON-556243204 May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: edcf57a6279243308232f9fbc8c158e2 May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesGetTestJSON-556243204 May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesGetTestJSON-556243204-project May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 24f3f03c71d94f56aefcf930f55c352a May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesGetTestJSON-556243204-project May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '661b843c-4507-4844-a0e3-85142bd93df2'} May 27 15:12:01.824218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. (HTTP 404) (Request-ID: req-cc8b7638-14b6-4c0e-b4cf-e6a6d04a2fe0) May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:01.824859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:12:01.825967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:12:01.826848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc6d9d85-1b4c-4fc4-a927-d8bbd39b551a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] Returning 404 to user: Volume 661b843c-4507-4844-a0e3-85142bd93df2 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc6d9d85-1b4c-4fc4-a927-d8bbd39b551a tempest-VolumesGetTestJSON-556243204 tempest-VolumesGetTestJSON-556243204-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2" status: 404 len: 109 microversion: 2.1 time: 0.075798 May 27 15:12:01.827883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 4/6] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/os-volumes/661b843c-4507-4844-a0e3-85142bd93df2 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:12:03.516136 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:03.516689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:03.517078 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:03.518380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:03.519650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:03.595189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.595645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.598639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.603342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.677102 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Getting quotas for project ef917e1df4a64838aba088201ddb8552. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:03.712078 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Getting quotas for user bf2f8a02c0ee46029b08a31d7ee9eec4 and project ef917e1df4a64838aba088201ddb8552. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:03.743215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:03.747703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:03.937958 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-12f07f7a-2b3e-4e43-a1b8-74d8298eda26 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.286142 May 27 15:12:03.951577 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 3/7] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:12:03.974441 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ceb11b71-794b-4a86-aba7-b0da1a7d0bc4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:03.977969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ceb11b71-794b-4a86-aba7-b0da1a7d0bc4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:04.416314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ceb11b71-794b-4a86-aba7-b0da1a7d0bc4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:04.444637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ceb11b71-794b-4a86-aba7-b0da1a7d0bc4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1215 microversion: 2.1 time: 0.492650 May 27 15:12:04.453342 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 5/8] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:03 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1215 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:05.469524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ebc82917-597d-45c4-b582-bef02786fffd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:05.470960 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ebc82917-597d-45c4-b582-bef02786fffd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:05.766178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ebc82917-597d-45c4-b582-bef02786fffd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:05.835420 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ebc82917-597d-45c4-b582-bef02786fffd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1215 microversion: 2.1 time: 0.371728 May 27 15:12:05.849442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 4/9] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:05 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:06.866307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:06.866957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:06.874741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.875195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.875977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.889418 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.312944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:07.341292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-523c0873-b4cd-4020-bd32-8b54fa88e588 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1211 microversion: 2.1 time: 0.478598 May 27 15:12:07.357920 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 6/10] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:06 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1211 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:08.365892 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.367181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.398349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.399355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.402220 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.402690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.830130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.859726 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-037937a4-e542-40a4-820f-1979401c170c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1273 microversion: 2.1 time: 0.499219 May 27 15:12:08.877734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 5/11] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1273 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:09.881236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:09.881851 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:09.894908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.895430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.896120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.899758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:10.424317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.461923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60737416-7ac1-435f-bc1d-f00d293e3a94 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1273 microversion: 2.1 time: 0.584417 May 27 15:12:10.468949 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 7/12] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:09 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1273 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:11.486517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:11.487271 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:11.501027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.501488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.507754 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.508905 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.793730 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:11.842962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2992ac7e-a640-4aa3-aa73-aa23ed56f3d7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1273 microversion: 2.1 time: 0.347024 May 27 15:12:11.842962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 6/13] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:11 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:12.858955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:12.860624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:12.873945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.876333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:12.881051 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.883045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.080697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.089340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3aa87ec3-8533-4aba-bb73-dfbf5755cbbf tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1273 microversion: 2.1 time: 0.234248 May 27 15:12:13.092095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 7/14] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:12 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:13.423184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6062d4b9-38c7-4d7e-a0c6-b8d51303d034 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: .version_select at 0x7fa37441a700>, body: {"keypair": {"name": "tempest-keypair-448927253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeLfK+DAhTVwjKBKZdr8tf5F9J0SN17SEAqFs4q0ZUfDne5Jw3ACdvQsPg5P73QSqOJbHgTbPiv3+ne7rS/YpjPAmk7IiUZ9rdIfn25xX8G4azkoegqbJCy82xYa3z97g=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:13.579842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-6062d4b9-38c7-4d7e-a0c6-b8d51303d034 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for project 72d5173b32b5480790babb3d178b94fb. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:13.597272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-6062d4b9-38c7-4d7e-a0c6-b8d51303d034 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for user 097084a3e57540d18bae448da3b3ecc4 and project 72d5173b32b5480790babb3d178b94fb. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:13.712181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6062d4b9-38c7-4d7e-a0c6-b8d51303d034 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.147007 May 27 15:12:13.724956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 8/15] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:12:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:14.110000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:14.110626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:14.123191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:14.128813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:14.130224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:14.133566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:14.136968 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:14.426821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:14.437303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-05c5db53-0555-41a2-8567-3346c41ab953 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1273 microversion: 2.1 time: 0.332098 May 27 15:12:14.457492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:14 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:15.483240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:15.484207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:15.503918 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.504378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.515793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.517321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.749120 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=8 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:17.328578 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-663342300", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:17.537229 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] validate_networks() for [('5328ba14-6e9c-4898-8e1e-5ccb3a5d834a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:18.397029 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:18.420842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-919eee96-107a-4050-89e1-c7767cbab538 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 2.947529 May 27 15:12:18.449719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 9/17] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:15 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 2979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:18.467104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1528513815", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa7d805a-200a-417c-8552-13b168c382aa"}], "security_groups": [{"name": "tempest-securitygroup--455720313"}], "key_name": "tempest-keypair-448927253", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:20.356362 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] validate_networks() for [('fa7d805a-200a-417c-8552-13b168c382aa', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:21.470999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:21.471523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:21.471884 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:21.472291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:21.472747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:21.499750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.500194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.509217 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.510038 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.614003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:21.621041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for user d25dc63e8a4c4af8af2fe29b7819212b and project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:21.652901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:21.656562 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:21.850433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-eff6385d-302c-49c7-bdd2-3504df1fb4c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.108734 May 27 15:12:21.853914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 9/18] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:12:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 5113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:22.885938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3ed0a8b8-956b-4f23-9f54-5002aee2e6b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: .version_select at 0x7fa37339ce50>, body: {"keypair": {"name": "tempest-keypair-1219859071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwEKZg9s09BNNJh5NhF2RCRfdgnR5gMMnhIR62XmC/BrTimtGK3Z0C6XXM4KLEDRzMXeZcVhFLU8Dqp4qNVGPFf73Dbsh4Ikm2k6/SzlwneUq/7iMb/QhprKoRqwPQEog=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:22.897891 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:22.899030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:22.899866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:22.900282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:22.900727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:22.961215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-3ed0a8b8-956b-4f23-9f54-5002aee2e6b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:22.969018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.972401 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.975075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.977821 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.003648 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-3ed0a8b8-956b-4f23-9f54-5002aee2e6b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:23.097348 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3ed0a8b8-956b-4f23-9f54-5002aee2e6b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.242042 May 27 15:12:23.108372 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 10/19] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:12:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:23.142977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.147613 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:23.175640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.185671 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for project 72d5173b32b5480790babb3d178b94fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:23.190836 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.193684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.202138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.209741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for user 097084a3e57540d18bae448da3b3ecc4 and project 72d5173b32b5480790babb3d178b94fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:23.269959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:23.291243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:23.450378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3834a2a-5a92-4a16-902e-b85322f5c22f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.999051 May 27 15:12:23.451870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 10/20] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:12:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 5001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:23.834701 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6cc7dc5c-6d49-494c-81d0-7a977f8a7e9b req-38ec3136-9c8e-4df3-b342-07e5fc8bc08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5f59e3-72be-4164-9117-b85ea68221c0", "tag": "759aef94-0828-4004-85eb-9b3aee7fc1c0"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:23.861971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6cc7dc5c-6d49-494c-81d0-7a977f8a7e9b req-38ec3136-9c8e-4df3-b342-07e5fc8bc08c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.863005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6cc7dc5c-6d49-494c-81d0-7a977f8a7e9b req-38ec3136-9c8e-4df3-b342-07e5fc8bc08c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.925937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6cc7dc5c-6d49-494c-81d0-7a977f8a7e9b req-38ec3136-9c8e-4df3-b342-07e5fc8bc08c service nova] Creating event network-changed:759aef94-0828-4004-85eb-9b3aee7fc1c0 for instance 3f5f59e3-72be-4164-9117-b85ea68221c0 on hv-cinder-84254 May 27 15:12:23.927152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6cc7dc5c-6d49-494c-81d0-7a977f8a7e9b req-38ec3136-9c8e-4df3-b342-07e5fc8bc08c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:12:23.928402 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.929142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.931388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.932468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.944263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.compute.rpcapi [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 15:12:23.946835 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] Releasing lock "compute-rpcapi-router" {{(pid=117642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:12:23.977808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0953a23c-51da-411b-98af-55a7d3ed5260 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522801 May 27 15:12:23.979154 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 11/21] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:23.984770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.985828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:24.001757 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.002428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.003571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.004309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.756333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:24.769016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75f5bf24-9bcf-48c4-84f2-6fd4be3fd3b1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1225 microversion: 2.1 time: 0.788447 May 27 15:12:24.772303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 12/22] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:23 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1225 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:24.776694 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:24.784819 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6923ac41-39c3-4d29-9fb9-cdcef37c8a8d tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 1.675195 May 27 15:12:24.785118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:24.795201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 11/23] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:23 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:24.796860 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:24.805179 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.806392 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.807705 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.808501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.993399 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.012471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9975cb7b-896a-4aaa-8842-75bda73837bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1241 microversion: 2.1 time: 0.237273 May 27 15:12:25.021599 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 13/24] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:24 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:25.127387 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1551294680", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:25.249996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] validate_networks() for [('5328ba14-6e9c-4898-8e1e-5ccb3a5d834a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:25.805216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.805872 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:25.813182 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:25.847968 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.850469 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.852308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.852832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.249127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.258747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3bb57fb8-cd10-476c-8103-9c9e1ac4cc31 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.459991 May 27 15:12:26.262222 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:25 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:26.266935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:26.268088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:26.269210 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:26.269768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:26.270615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:26.276802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:26.279649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:26.285803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.286940 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.289274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.289867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.291890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.298331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.299877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.300394 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.325037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:26.331452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for user d25dc63e8a4c4af8af2fe29b7819212b and project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:26.354189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:26.356776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:26.435338 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.446866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8c20fbfc-b583-4b0a-9214-0e838c21769b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1297 microversion: 2.1 time: 0.183528 May 27 15:12:26.448832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 15/26] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:26 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:26.472138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e874b739-0a5c-40d4-adaa-9fe3802024b5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.349229 May 27 15:12:26.479618 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 12/27] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:12:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:26.485600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cd099c26-2c74-48b0-8cd9-b26ad61b6a0e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:26.486472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cd099c26-2c74-48b0-8cd9-b26ad61b6a0e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:26.602096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cd099c26-2c74-48b0-8cd9-b26ad61b6a0e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.614316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:26.618963 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cd099c26-2c74-48b0-8cd9-b26ad61b6a0e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1222 microversion: 2.1 time: 0.136521 May 27 15:12:26.629984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 16/28] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:26 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:27.279065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:27.279682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:27.291434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.294166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.295474 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.301483 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.466725 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:27.468413 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:27.494925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.496196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.499521 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.500813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.947371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:27.967537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad98b6d1-ac1d-480c-9188-ea8c1d7be9ea tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1295 microversion: 2.1 time: 0.504854 May 27 15:12:27.968910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 17/29] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:27 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1295 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:27.979404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:27.982092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.002435 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.002902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.003692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.004141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.146893 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.158743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-55e239f0-29f9-4104-8146-2f27ebeac87f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1274 microversion: 2.1 time: 0.188235 May 27 15:12:28.159856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 18/30] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:27 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:28.208537 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.221002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-84eb8ade-032f-4d06-b450-2192ac0152a4 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.946548 May 27 15:12:28.227872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 13/31] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:27 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:28.987664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.989227 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:29.012129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.015665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.018479 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.026939 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.184787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:29.186626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:29.198325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.199844 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.201337 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.202142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.598833 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.621577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b8bba78-11aa-486c-96fd-dc2f4162dc04 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1295 microversion: 2.1 time: 0.636515 May 27 15:12:29.622637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 19/32] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:28 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1295 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:29.632684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.639060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=47 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:29.641694 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1cfa8b1a-8a2c-401e-95eb-d7f9a34285f1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1280 microversion: 2.1 time: 0.464490 May 27 15:12:29.648510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 14/33] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:29 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1280 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:29.650518 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:29.651351 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:29.670321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.671222 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.673387 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.676192 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.060755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-854573077", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25b92ae9-fc97-4437-8dc2-335b8971db2a"}], "security_groups": [{"name": "tempest-securitygroup--1208059810"}], "key_name": "tempest-keypair-1219859071", "user_data": "}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:30.083922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:30.099199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.109673 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-294b6315-1278-4b62-bd76-0a4e84308995 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.471621 May 27 15:12:30.125383 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 20/34] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:29 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:30.393724 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2ec0da28-4381-4385-b587-44ea962574cc req-1d3c1896-b6d5-4a80-ac54-a925e72cc5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f59e3-72be-4164-9117-b85ea68221c0", "name": "network-vif-plugged", "status": "completed", "tag": "759aef94-0828-4004-85eb-9b3aee7fc1c0"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:30.432357 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2ec0da28-4381-4385-b587-44ea962574cc req-1d3c1896-b6d5-4a80-ac54-a925e72cc5c4 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.434609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2ec0da28-4381-4385-b587-44ea962574cc req-1d3c1896-b6d5-4a80-ac54-a925e72cc5c4 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.458903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2ec0da28-4381-4385-b587-44ea962574cc req-1d3c1896-b6d5-4a80-ac54-a925e72cc5c4 service nova] Creating event network-vif-plugged:759aef94-0828-4004-85eb-9b3aee7fc1c0 for instance 3f5f59e3-72be-4164-9117-b85ea68221c0 on hv-cinder-84254 May 27 15:12:30.485861 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2ec0da28-4381-4385-b587-44ea962574cc req-1d3c1896-b6d5-4a80-ac54-a925e72cc5c4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336388 May 27 15:12:30.487813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 21/35] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:30.640290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:30.641167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:30.651279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.651743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.668661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.669435 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.980880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] validate_networks() for [('25b92ae9-fc97-4437-8dc2-335b8971db2a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:31.524554 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:31.532118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-10d97794-8e4a-4044-9e08-def0e2a46eb0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.896014 May 27 15:12:31.536218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 22/36] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:30 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:31.550039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:31.550665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:31.560909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.561377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.562170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.562617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.197772 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.205654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6e70a1c3-10a2-45c2-a537-4b781a42c55c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.668175 May 27 15:12:32.216166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 23/37] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:31 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:32.221119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.221958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:32.228810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.229270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.230225 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.230816 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.440932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:32.441848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:32.442665 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:32.443721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:32.445857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:32.469150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.470739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.472798 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.473469 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.504484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:32.521326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:32.539096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:32.541576 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:32.615977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.630654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f658fa9c-6bde-4c24-b20b-1eaca96cf4a6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.410205 May 27 15:12:32.634117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 24/38] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:32.640720 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-457209fe-5171-443a-8329-f04920c80c66 req-0d7b66d9-a971-4825-89b2-61a69f7e1f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e89d631-1962-4ed9-a49a-96fe0948d096", "tag": "50dd4811-1b47-422c-9bcd-2b24d3055609"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:32.651202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-457209fe-5171-443a-8329-f04920c80c66 req-0d7b66d9-a971-4825-89b2-61a69f7e1f98 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.653007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-457209fe-5171-443a-8329-f04920c80c66 req-0d7b66d9-a971-4825-89b2-61a69f7e1f98 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.668516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-39c296b5-2950-4a0f-9ee7-77e76bca4165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.615695 May 27 15:12:32.669159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 15/39] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:12:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:32.670868 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-457209fe-5171-443a-8329-f04920c80c66 req-0d7b66d9-a971-4825-89b2-61a69f7e1f98 service nova] Creating event network-changed:50dd4811-1b47-422c-9bcd-2b24d3055609 for instance 4e89d631-1962-4ed9-a49a-96fe0948d096 on hv-cinder-84254 May 27 15:12:32.678281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-457209fe-5171-443a-8329-f04920c80c66 req-0d7b66d9-a971-4825-89b2-61a69f7e1f98 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042615 May 27 15:12:32.680180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 25/40] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:32.687251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2ecc98e4-2c22-4c72-bd15-2409cff5bf83 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.688389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ecc98e4-2c22-4c72-bd15-2409cff5bf83 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:32.692845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.693481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:32.724495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.726867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.727960 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.731171 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.234788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ecc98e4-2c22-4c72-bd15-2409cff5bf83 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.243066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2ecc98e4-2c22-4c72-bd15-2409cff5bf83 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1241 microversion: 2.1 time: 0.560990 May 27 15:12:33.255853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 26/41] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1241 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:33.262867 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:33.264041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:33.272117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.273721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.274917 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.275604 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.569013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.584326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9ac440e1-2875-4feb-a2af-924eed7dc848 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.908039 May 27 15:12:33.584927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 16/42] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:33.624337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.632131 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:33.640208 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4f81ccc5-dbdc-4fb3-a2bd-e6cb2fbbd04c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.381008 May 27 15:12:33.641387 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 27/43] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:33 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:33.652244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:33.656766 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:33.667246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.667946 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.668851 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.669462 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.970984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.990524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d967fffa-01cb-4b8d-84f2-ac2be4867479 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.342381 May 27 15:12:33.991524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 17/44] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:33 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.264355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.265003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.273747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:34.278229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.278689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.282310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.286243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.395301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.406200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-85b63ac2-272f-4746-b14c-0f107b494cca tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1245 microversion: 2.1 time: 0.147478 May 27 15:12:34.407106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 28/45] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.461932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-5b56d6a3-4b75-4cdd-8704-cc0c6e1b2c34 req-ec35db4b-ffbc-4b82-95b5-6b45f4596d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4fbebd8-749c-4afa-901d-cb88ccb3682a", "tag": "f267f173-ac83-4368-b018-5052c6c6d82d"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:34.473538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-5b56d6a3-4b75-4cdd-8704-cc0c6e1b2c34 req-ec35db4b-ffbc-4b82-95b5-6b45f4596d05 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.473933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-5b56d6a3-4b75-4cdd-8704-cc0c6e1b2c34 req-ec35db4b-ffbc-4b82-95b5-6b45f4596d05 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.495273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-5b56d6a3-4b75-4cdd-8704-cc0c6e1b2c34 req-ec35db4b-ffbc-4b82-95b5-6b45f4596d05 service nova] Creating event network-changed:f267f173-ac83-4368-b018-5052c6c6d82d for instance d4fbebd8-749c-4afa-901d-cb88ccb3682a on hv-cinder-84254 May 27 15:12:34.495796 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-5b56d6a3-4b75-4cdd-8704-cc0c6e1b2c34 req-ec35db4b-ffbc-4b82-95b5-6b45f4596d05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:12:34.497070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.497504 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.498280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.498708 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.508585 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.compute.rpcapi [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 15:12:34.509384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] Releasing lock "compute-rpcapi-router" {{(pid=117641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:12:34.528424 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cb1a6479-b5cd-4843-aa21-b0bd87c7a564 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148907 May 27 15:12:34.529423 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 18/46] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:34.617668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.618287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.624697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.625302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.625924 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.626474 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.657738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.658443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.665038 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.665489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.666267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.666710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.821520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.830966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cc158c9d-1ca2-47eb-9aaf-19cf13313cfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.217855 May 27 15:12:34.831464 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 29/47] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.841051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-3e76dba2-aac9-4f70-8b3e-305b4833982d req-88e35dd2-8ec5-4726-ab2d-43bc8754cfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90285ea2-a28f-4844-9a8a-652ecafc72ef", "tag": "5737ab7a-1d8d-4ce7-85ab-97d0a121905d"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:34.850016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3e76dba2-aac9-4f70-8b3e-305b4833982d req-88e35dd2-8ec5-4726-ab2d-43bc8754cfac service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.850676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3e76dba2-aac9-4f70-8b3e-305b4833982d req-88e35dd2-8ec5-4726-ab2d-43bc8754cfac service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.862894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-3e76dba2-aac9-4f70-8b3e-305b4833982d req-88e35dd2-8ec5-4726-ab2d-43bc8754cfac service nova] Creating event network-changed:5737ab7a-1d8d-4ce7-85ab-97d0a121905d for instance 90285ea2-a28f-4844-9a8a-652ecafc72ef on hv-cinder-84254 May 27 15:12:34.864370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.869595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-3e76dba2-aac9-4f70-8b3e-305b4833982d req-88e35dd2-8ec5-4726-ab2d-43bc8754cfac service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036560 May 27 15:12:34.870430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 30/48] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:34.873216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bf8e8926-3bf1-451d-934f-029872876d2f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.219701 May 27 15:12:34.874180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 19/49] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:35.008094 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.008957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.015207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.015661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.016422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.016886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.158369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.166765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6f3e7baf-75ad-428c-9b34-a2f6bbfe6872 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.163466 May 27 15:12:35.167334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 31/50] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:35.423683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.424303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.430413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.430869 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.431651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.432152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.494817 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.502128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1711fe2b-f0fd-4390-bd15-192036e05709 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1245 microversion: 2.1 time: 0.082476 May 27 15:12:35.502739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 20/51] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:35.848847 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.849456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.857612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.858091 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.858877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.859306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.893659 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.894938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.903512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.904330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.905887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.906474 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.049282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.065682 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c81c550b-ede1-4a43-9802-88f28e3aff2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.220788 May 27 15:12:36.066268 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 32/52] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:36.104151 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.114550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8c21027e-28ce-4326-87dc-d6f3f8bf1f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.225790 May 27 15:12:36.115140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 21/53] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:36.200480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:36.201683 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:36.221497 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.222238 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.223574 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.224377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.518904 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:36.519782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:36.529725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.530189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.530975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.531414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.625737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.634879 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ee1a299-a0bf-49e2-a7af-98d86ea37b47 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1315 microversion: 2.1 time: 0.453684 May 27 15:12:36.636110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 33/54] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:36 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:36.643891 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.652249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-03dfa6ca-565c-4863-a327-35d687ec9204 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1293 microversion: 2.1 time: 0.137085 May 27 15:12:36.652863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 22/55] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:36 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:37.090350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.091524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:37.115371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.117971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.121571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.123456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.134680 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.136549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:37.147273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.152178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.154987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.157172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.524054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:37.536206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-745cbbb5-2090-431a-be69-0bd9a4b07e69 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.453665 May 27 15:12:37.540767 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:37.541015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 34/56] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:37.553705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-18263a56-f970-4a9d-883a-ac2ae70b3f0f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.425257 May 27 15:12:37.555034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 23/57] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:37.652781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.653637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:37.664626 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.667190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.668219 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.669638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.671499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.672330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:37.683992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.693493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.694331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.695525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.865443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:37.874775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-76564105-1c5d-43cf-83f5-b09989a3a101 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1299 microversion: 2.1 time: 0.207609 May 27 15:12:37.875439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 24/58] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:38.370136 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:38.379587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4c282a31-63f5-4bcf-87cb-49081af73c4b tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1501 microversion: 2.1 time: 0.730532 May 27 15:12:38.389204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 35/59] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:38.555475 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.556086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:38.568015 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.570921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.571918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.572034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.572786 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:38.573503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.589715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.592314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.597753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.598230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.200428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:39.214866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11c28e24-2146-420c-b8ef-54c2ae99c9d6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.647078 May 27 15:12:39.216874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 36/60] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:39.224415 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:39.225975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:39.235111 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.236330 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.237485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.238027 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.292321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:39.302674 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-95ca4eeb-bc39-45aa-a007-321d93a6a6b5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.752362 May 27 15:12:39.304241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 25/61] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:39.357854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:39.368940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-40e8c264-78dc-4bcd-93d3-93365d462e8c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1299 microversion: 2.1 time: 0.150488 May 27 15:12:39.369633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 37/62] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:39 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:40.127487 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a28712-7e77-46d6-9465-63a5c53928e1"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:40.128819 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:40.136654 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.137443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.138431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.139268 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.235903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:40.236672 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:40.269304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.273640 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.274706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.277472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.737838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:40.793212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4820b76d-1caa-498d-a023-94e1aba97129 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.563951 May 27 15:12:40.793837 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 38/63] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:40 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:40.806032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-8119f08f-666d-4eff-8564-b6a8dfd7bf21 req-13d3c68a-e701-467e-a977-a6b6ce4e106c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e89d631-1962-4ed9-a49a-96fe0948d096", "name": "network-vif-plugged", "status": "completed", "tag": "50dd4811-1b47-422c-9bcd-2b24d3055609"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:40.834251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8119f08f-666d-4eff-8564-b6a8dfd7bf21 req-13d3c68a-e701-467e-a977-a6b6ce4e106c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.834824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8119f08f-666d-4eff-8564-b6a8dfd7bf21 req-13d3c68a-e701-467e-a977-a6b6ce4e106c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.850161 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-8119f08f-666d-4eff-8564-b6a8dfd7bf21 req-13d3c68a-e701-467e-a977-a6b6ce4e106c service nova] Creating event network-vif-plugged:50dd4811-1b47-422c-9bcd-2b24d3055609 for instance 4e89d631-1962-4ed9-a49a-96fe0948d096 on hv-cinder-84254 May 27 15:12:40.860269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-8119f08f-666d-4eff-8564-b6a8dfd7bf21 req-13d3c68a-e701-467e-a977-a6b6ce4e106c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057871 May 27 15:12:40.861148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 39/64] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:40.877309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:40.878723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:40.887192 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.888018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.889890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.890830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.299557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:41.318958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-14c795ad-622c-4386-b488-4efaa49cabc6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.448885 May 27 15:12:41.320630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 40/65] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:40 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:41.327169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.329494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.358339 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.359130 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.361699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.362338 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.532004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-537f7e92-55c5-4c47-b270-0005dca4d087 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "POST /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.409829 May 27 15:12:41.537873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 26/66] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:12:40 2022] POST /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0/os-volume_attachments => generated 194 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:41.662263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:41.694647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-408c49df-f6d5-4a5c-a918-12b96edbd34e tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.372643 May 27 15:12:41.707700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 41/67] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:41.755805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-45f0d657-0fcb-4f7f-9687-c16b1ef98e97 req-df3deecf-83fb-4b8d-ae69-9a30d53c6bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d00cd5-e391-4c55-a071-152ec1cf4c04", "tag": "806f4f1c-0d26-4fec-be62-86145b66b5e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:41.770798 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-45f0d657-0fcb-4f7f-9687-c16b1ef98e97 req-df3deecf-83fb-4b8d-ae69-9a30d53c6bd6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.774450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-45f0d657-0fcb-4f7f-9687-c16b1ef98e97 req-df3deecf-83fb-4b8d-ae69-9a30d53c6bd6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.796436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-45f0d657-0fcb-4f7f-9687-c16b1ef98e97 req-df3deecf-83fb-4b8d-ae69-9a30d53c6bd6 service nova] Creating event network-changed:806f4f1c-0d26-4fec-be62-86145b66b5e8 for instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 on hv-cinder-84254 May 27 15:12:41.810675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.811285 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.818874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.819398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.821379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-45f0d657-0fcb-4f7f-9687-c16b1ef98e97 req-df3deecf-83fb-4b8d-ae69-9a30d53c6bd6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070047 May 27 15:12:41.823095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 27/68] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:41.825453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.827737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.068263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.078117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e01547e9-1e9a-42bd-84bb-502bb1e94e9e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.270895 May 27 15:12:42.087812 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 42/69] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:42.337539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:42.339300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:42.354207 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.355168 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.360240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.360904 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.534475 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=22 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:42.714852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:42.716978 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:42.723804 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.726969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.728715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.730261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.829498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.838053 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8c35bbf8-bb7e-47ca-b1ea-f5f446d2e093 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.505561 May 27 15:12:42.838927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 28/70] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:42 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:42.937716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.946959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a62271b-76c7-4e48-a867-557c98237fd4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.238635 May 27 15:12:42.947704 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 43/71] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:42 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:43.095260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.095877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.102315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.102769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.103532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.103978 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.254727 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:43.262950 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9c579cf2-22f9-4405-a2c8-ec2c27d000af tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.171426 May 27 15:12:43.263713 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 29/72] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:43.855930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.856788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.859007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:43.864799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.865487 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.867309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.868060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.964561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.966157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.974144 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.975198 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.978134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.979164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.018915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.029907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-59ea7cee-5847-46cc-a78c-748edeceeba7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.175562 May 27 15:12:44.041609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 44/73] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:44.280258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.281886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.282699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.289404 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-86b149a1-d443-4e02-9625-b30bcda83867 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.329658 May 27 15:12:44.290112 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 30/74] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:44.296133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.296630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.297412 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.297857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.511244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.517928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:44.520439 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca80e4d1-2c58-4ee4-aabd-d1fc937e92e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.242986 May 27 15:12:44.530832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 45/75] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:45.051080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.051701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.054793 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=8 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:45.060149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.061534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.064199 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.064857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.226948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.243332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:45.249952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-90e04f65-65a3-436a-b772-fed16f4e2363 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.206702 May 27 15:12:45.251416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 31/76] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:45.307817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.309123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.315829 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.316281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.317133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.317580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.488641 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.497315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f0e0f210-34d9-47ae-aed9-ecb50302ef73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.194157 May 27 15:12:45.498103 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 46/77] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:45.540171 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.540891 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.547968 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.548526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.549437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.549914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.691903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.700828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f1ece1fb-d3a1-4b8b-95a9-11603a7efeec tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.166028 May 27 15:12:45.701873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 32/78] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:46.268998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.269608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:46.276872 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.277327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.278059 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.278489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.425272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:46.434522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ee4f15c-434d-401f-9970-77b5b6c3fa2c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.169332 May 27 15:12:46.435092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 47/79] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:46.515043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.516295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:46.523418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.523867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.524676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.525134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.654014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:46.661568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1bece25a-3d0d-4ae6-a797-8765eb5ecc46 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.150457 May 27 15:12:46.662128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 33/80] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:46.718747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.719433 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:46.725682 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.726164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.726994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.727410 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.885567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:46.893901 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fb49dbb8-4d7b-41f1-8c1c-1859f6eaf989 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.178668 May 27 15:12:46.894626 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 48/81] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.451293 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:47.451912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.458105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.458562 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.459335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.460403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.593864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.602187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b4bcb4b0-fb91-48f4-9808-696fca8aef58 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.154824 May 27 15:12:47.603041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 34/82] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.679770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:47.680418 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.686797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.687255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.688027 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.688488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.821999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.829456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c5d95106-8ed1-400d-8443-b1574bb2c558 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.154364 May 27 15:12:47.830020 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 49/83] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.910561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:47.911173 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.917843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.918296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.919058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.919495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.044538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.052299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bc8dc1ac-e0cd-413c-8152-05fefd843552 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.145254 May 27 15:12:48.052909 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 35/84] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.620097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.620739 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.626640 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.627364 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.628292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.628905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.769797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.777811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60b81bd1-35bb-4ec3-b228-8cec593c1b71 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.161988 May 27 15:12:48.778364 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 50/85] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.846596 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.847200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.854628 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.855071 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.855824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.856253 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.985538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.993662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c4ec6cd2-2520-4b76-8e3c-c4e8ceab5a9c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.150933 May 27 15:12:48.994219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 36/86] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:49.069113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.069826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:49.075775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.076223 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.077021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.077462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.207679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:49.215113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2c58aba8-7358-418b-a50f-6e652d89e449 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.149845 May 27 15:12:49.215674 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 51/87] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:49.794799 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.795413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:49.801692 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.802143 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.802948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.803397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.936704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:49.944084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-55c285f5-5255-498d-90fb-f722c41f5aee tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.153226 May 27 15:12:49.944703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 37/88] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:50.010237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.010843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.016861 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.017311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.018065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.018502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.142138 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:50.150003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8712cac4-df95-4d7b-8e22-d6be07810631 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.143655 May 27 15:12:50.150560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 52/89] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:50.232325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.232963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.238890 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.239383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.240087 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.240550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.370833 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:50.378439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d6d03bc0-1cf0-434d-942a-5028fb00b021 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.149920 May 27 15:12:50.379012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 38/90] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:50.961307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.961914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.968106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.968602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.969370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.969808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.098216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.105648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-328e354a-61e0-4fdf-9b4d-48d00564cb15 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.148687 May 27 15:12:51.106209 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 53/91] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:51.166471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.167084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.173547 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.174006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.174776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.175220 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.306438 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.313847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-76c777a8-69b5-42a2-94e0-8e0af7882a73 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.151240 May 27 15:12:51.314413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 39/92] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:51.395018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.395617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.401682 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.402133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.402880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.403310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.534503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.541965 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d80678e-a21d-40d7-8574-39c202ce3fe5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.150788 May 27 15:12:51.542524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 54/93] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.122531 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.123161 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.129294 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.129893 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.130509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.130955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.264429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.271778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8a4037ba-c8a0-411c-acdc-564d58c078a6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.153218 May 27 15:12:52.273128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 40/94] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.330305 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.330918 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.337267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.337719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.338482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.338921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.477991 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.485363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ba06cdea-7d1d-4bd0-9c37-7925950de99d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.158949 May 27 15:12:52.486034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 55/95] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.557897 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.558535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.564556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.565015 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.565808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.566252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.691952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.699865 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-58106bfe-6592-4d2b-9d62-cedbad9b2ce8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.146385 May 27 15:12:52.700430 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 41/96] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:53.290493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.291097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.297066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.297517 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.298272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.298703 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.429909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:53.437246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62ad4169-96bf-45bf-b3cf-76cfda6a3188 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.151511 May 27 15:12:53.437809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 56/97] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:53.503052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.503705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.510546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.511002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.511769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.512214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.645643 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:53.653336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bc67fb7a-c982-4654-a9a9-31c264714c3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.154285 May 27 15:12:53.653907 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 42/98] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:53.717007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.717580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.723774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.724235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.725088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.726102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.856377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:53.863692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bcaff6f7-03ed-448c-a904-f652c902c18f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.151243 May 27 15:12:53.864254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 57/99] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:54.455258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:54.455867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:54.462583 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.463034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.463796 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.464666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.593864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:54.601314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-434d6b25-4bf1-4e96-85d7-945d4b3d09ed tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.149927 May 27 15:12:54.601875 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 43/100] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:54 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:54.669803 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:54.670414 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:54.676525 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.676980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.677773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.678706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.802508 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:54.810508 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7e2c9cc6-f38a-4508-a79f-67f0e5fe3e84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.144474 May 27 15:12:54.811072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 58/101] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:54 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:54.880043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:54.880691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:54.888122 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.888932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.889783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.890519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.006911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-aa17586e-0433-4a36-b86b-e31f78fd8f08 req-4369fde2-b744-4a44-a243-e5a9ab389829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fbebd8-749c-4afa-901d-cb88ccb3682a", "name": "network-vif-plugged", "status": "completed", "tag": "f267f173-ac83-4368-b018-5052c6c6d82d"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:55.016198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-aa17586e-0433-4a36-b86b-e31f78fd8f08 req-4369fde2-b744-4a44-a243-e5a9ab389829 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.016881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-aa17586e-0433-4a36-b86b-e31f78fd8f08 req-4369fde2-b744-4a44-a243-e5a9ab389829 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.031430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-aa17586e-0433-4a36-b86b-e31f78fd8f08 req-4369fde2-b744-4a44-a243-e5a9ab389829 service nova] Creating event network-vif-plugged:f267f173-ac83-4368-b018-5052c6c6d82d for instance d4fbebd8-749c-4afa-901d-cb88ccb3682a on hv-cinder-84254 May 27 15:12:55.037129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-aa17586e-0433-4a36-b86b-e31f78fd8f08 req-4369fde2-b744-4a44-a243-e5a9ab389829 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033806 May 27 15:12:55.038967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 59/102] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:55.050454 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:55.058654 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7eb19643-d748-413f-8246-c20e3bc78298 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.182411 May 27 15:12:55.059272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 44/103] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:54 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:55.618527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:55.619219 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:55.625337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.625788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.626547 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.626983 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.774623 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:55.782464 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a654f62f-776e-49e7-9f49-887c4a9d3635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.168105 May 27 15:12:55.783031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 60/104] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:55 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:55.827510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:55.828134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:55.835833 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.836323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.837156 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.837588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.015724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:56.024253 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6481c16f-0172-48a3-a594-900d9f5bc7b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.200758 May 27 15:12:56.025177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 45/105] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:55 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:56.075755 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:56.076479 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:56.078416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=98 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:56.083729 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.084249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.085090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.085531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.224252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:56.232007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c470965e-1d8e-415d-9b06-71f54dbaaf76 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1322 microversion: 2.1 time: 0.160198 May 27 15:12:56.232686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 61/106] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:56 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:56.801882 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:56.802796 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:56.816094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.821349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.823278 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.823802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.043510 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:57.044237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:57.048791 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:57.055138 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.055595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.059786 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.060278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.062965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-79a3eee2-103a-4741-8209-3209dbfacd42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.265048 May 27 15:12:57.064287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 46/107] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:56 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:57.080340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-4a7f3eec-919c-4db5-bc83-2e5e0d320f6d req-49379498-83de-42c8-893e-0d9d3748ecbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90285ea2-a28f-4844-9a8a-652ecafc72ef", "name": "network-vif-plugged", "status": "completed", "tag": "5737ab7a-1d8d-4ce7-85ab-97d0a121905d"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:57.095047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4a7f3eec-919c-4db5-bc83-2e5e0d320f6d req-49379498-83de-42c8-893e-0d9d3748ecbc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.095579 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4a7f3eec-919c-4db5-bc83-2e5e0d320f6d req-49379498-83de-42c8-893e-0d9d3748ecbc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.129208 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-4a7f3eec-919c-4db5-bc83-2e5e0d320f6d req-49379498-83de-42c8-893e-0d9d3748ecbc service nova] Creating event network-vif-plugged:5737ab7a-1d8d-4ce7-85ab-97d0a121905d for instance 90285ea2-a28f-4844-9a8a-652ecafc72ef on hv-cinder-84254 May 27 15:12:57.150314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-4a7f3eec-919c-4db5-bc83-2e5e0d320f6d req-49379498-83de-42c8-893e-0d9d3748ecbc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073991 May 27 15:12:57.153682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 47/108] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:57.251619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:57.257600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:57.263974 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:57.286569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9b7aaf56-0ca7-4149-ba18-45a764f3c1a4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.248953 May 27 15:12:57.294482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 62/109] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:57 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:57.296901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.297721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.298862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.299594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.556562 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:57.566052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7e6697da-7491-4d9f-90c8-ba313cc36b45 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1516 microversion: 2.1 time: 0.320116 May 27 15:12:57.567323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 48/110] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:57 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:57.587476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:57.589685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:57.600801 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.601891 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.603165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.603836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.644333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:57.721951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lazy-loading 'flavor' on Instance uuid d4fbebd8-749c-4afa-901d-cb88ccb3682a {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:12:58.083844 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:58.083844 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:58.090491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.091199 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.091971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.092673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.097925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=100 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:58.126908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-05eb6385-830c-4931-b342-1e08fb7575e4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a/action" status: 200 len: 32 microversion: 2.1 time: 0.545772 May 27 15:12:58.128687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 63/111] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:12:57 2022] POST /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a/action => generated 32 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:12:58.138979 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:58.139702 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:58.146618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.147164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.148048 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.148698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.616351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:58.624596 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:58.627121 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cbc3fd5f-48a5-424a-bacf-690a3b3460aa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.549682 May 27 15:12:58.637216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32dd992a-c5e5-4639-a5ad-1ccc720bdbf3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.500419 May 27 15:12:58.638070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 49/112] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:58 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:58.643365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 64/113] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:58 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:58.643944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:58.644540 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:58.652043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.652541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.653333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.653782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.914378 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:58.926074 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1ebde5a8-f8d7-4384-be82-cb3cefdd81ab tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.286232 May 27 15:12:58.926913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 50/114] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:58 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:59.170627 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d6dac8c4-ab05-4745-8b5f-00547db9cf6c req-b7ca17e5-c63c-48cc-bbd0-4b93db1e726f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d00cd5-e391-4c55-a071-152ec1cf4c04", "name": "network-vif-plugged", "status": "completed", "tag": "806f4f1c-0d26-4fec-be62-86145b66b5e8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:59.183605 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d6dac8c4-ab05-4745-8b5f-00547db9cf6c req-b7ca17e5-c63c-48cc-bbd0-4b93db1e726f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.184264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d6dac8c4-ab05-4745-8b5f-00547db9cf6c req-b7ca17e5-c63c-48cc-bbd0-4b93db1e726f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.202714 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d6dac8c4-ab05-4745-8b5f-00547db9cf6c req-b7ca17e5-c63c-48cc-bbd0-4b93db1e726f service nova] Creating event network-vif-plugged:806f4f1c-0d26-4fec-be62-86145b66b5e8 for instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 on hv-cinder-84254 May 27 15:12:59.210833 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d6dac8c4-ab05-4745-8b5f-00547db9cf6c req-b7ca17e5-c63c-48cc-bbd0-4b93db1e726f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043683 May 27 15:12:59.212407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 65/115] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:59.645827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.654137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.655154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.659275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.676434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.680125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.682087 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.682820 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.683358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.684585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.688421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.689087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.940080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.948378 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.957369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9da1c2a2-c806-4a21-bf23-776647c3f594 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.315608 May 27 15:12:59.957973 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 51/116] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:59.958429 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a770175-3ad0-4281-b1dd-e4217fd31fbf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.309788 May 27 15:12:59.960103 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 66/117] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:59.972636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.973249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.982380 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.982856 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.985236 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.985898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.117244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:00.124532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a5677b44-ee04-4ec8-ac4a-1c58679f931f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.165369 May 27 15:13:00.125090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 52/118] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:00.975507 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.976212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.986612 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.986612 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.987136 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.987136 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.987136 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.987362 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:00.987447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.987538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.987695 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.988574 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.989080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.165298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.172554 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a94699ea-df52-417e-83c7-121bc6c2dbda tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1362 microversion: 2.1 time: 0.201299 May 27 15:13:01.173114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 67/119] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:01.177540 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:01.178134 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:01.184545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:01.184992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.185744 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:01.186178 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.191062 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.199350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3199dfc1-bf79-4ade-9a2e-06a92a7bfd9d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.225011 May 27 15:13:01.200262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 53/120] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:01.328025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.336371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6a6758d7-e721-4f2f-89a8-645ee6cafa4d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.162325 May 27 15:13:01.336954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 68/121] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:01 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:02.189725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.190332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.196871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.197325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.198252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.198753 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.216688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.217301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.223446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.223904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.224708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.225844 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.407013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.410369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.415592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-53a37d25-9140-4ca5-9ba5-0be48ab68078 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1547 microversion: 2.1 time: 0.230081 May 27 15:13:02.416256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 54/122] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:02.418690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ea9bd3aa-7002-44f0-81d6-53f4fa85e46b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.206190 May 27 15:13:02.419540 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 69/123] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:02.421300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.421966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.428323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.429105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.429880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.430317 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.432785 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.433272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.439298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.439752 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.440539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.440979 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.553543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e751b62a-5903-4fa8-947d-47707503b91a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124257 May 27 15:13:02.554372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 70/124] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:02.600146 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.614397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d6af2d04-2721-43bf-89fd-d3077aa0c0b8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.196904 May 27 15:13:02.614982 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 55/125] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:03.435106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:03.435716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:03.445183 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.446103 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.447128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.447740 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.632311 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:03.635786 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.638392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:03.646191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.646650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.647879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.648321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.652068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9fd962c4-545e-4b6e-97e8-b66f32b0613c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.220712 May 27 15:13:03.652964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 71/126] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:03 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:03.792921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.802034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bc717644-5a0e-4726-907f-433ea11d2b32 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.174562 May 27 15:13:03.802861 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 56/127] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:03 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:04.051841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-068062be-afe9-4793-ad7b-161860bf3886 req-cb468874-661d-4481-bbc7-5620e0a567be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90285ea2-a28f-4844-9a8a-652ecafc72ef", "tag": "5737ab7a-1d8d-4ce7-85ab-97d0a121905d"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:04.062056 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-068062be-afe9-4793-ad7b-161860bf3886 req-cb468874-661d-4481-bbc7-5620e0a567be service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.062904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-068062be-afe9-4793-ad7b-161860bf3886 req-cb468874-661d-4481-bbc7-5620e0a567be service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.076557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-068062be-afe9-4793-ad7b-161860bf3886 req-cb468874-661d-4481-bbc7-5620e0a567be service nova] Creating event network-changed:5737ab7a-1d8d-4ce7-85ab-97d0a121905d for instance 90285ea2-a28f-4844-9a8a-652ecafc72ef on hv-cinder-84254 May 27 15:13:04.086083 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-068062be-afe9-4793-ad7b-161860bf3886 req-cb468874-661d-4481-bbc7-5620e0a567be service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037949 May 27 15:13:04.086813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 72/128] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:04.669665 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:04.670293 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:04.676660 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.677179 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.678054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.678834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.812126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:04.821205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6fe9a622-8a87-48f4-ae75-6460b0cd7919 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.155560 May 27 15:13:04.821623 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:04.822484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:04.829994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.830442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.831321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.831733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 57/129] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:04 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:04.831848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.976279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:04.984060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ea2e67c-af0e-4609-be6b-506169bf17d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.167230 May 27 15:13:04.989137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 73/130] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:04 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:05.838173 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:05.838786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.845590 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.846046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.846806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.847247 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.975598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.983177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-22ce9f51-fbbe-45f6-bb73-9e8258b70a16 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.149500 May 27 15:13:05.983741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 58/131] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:05 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:06.000848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:06.001447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:06.007638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.008080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.008852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.009284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.138495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:06.145848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-323198f7-27ca-499b-8f2e-bd068c25cde9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.148741 May 27 15:13:06.146404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 74/132] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:05 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:07.003705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:07.004934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:07.017776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.019084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.020191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.021399 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.163459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:07.164065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:07.169967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.170419 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.171184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.171621 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.204899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:07.212680 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-22ff0c85-4bc5-46b5-bad9-a35889afe1f4 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.216259 May 27 15:13:07.213338 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 59/133] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:06 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:07.307239 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:07.314622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-93ff7f9d-e34d-4625-9f8e-643f11a6c5b2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.155506 May 27 15:13:07.315181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 75/134] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:07 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:08.229926 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.230456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.236915 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.237361 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.238172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.238605 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.333416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.334264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.341020 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.342067 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.342401 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.342835 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.430013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.442331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3a07f2ef-ea9b-4499-bb78-0323924d1b6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.216922 May 27 15:13:08.445014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 60/135] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:08.545636 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.561347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.562412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.570171 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.570923 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.571805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.572123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-df9f9d83-6fda-45d9-b269-c053edc6db95 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.244042 May 27 15:13:08.572408 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.574759 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 76/136] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:08.599728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:08.693907 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c83e592f-b030-4f69-96ad-04b7ff127990 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 204 len: 0 microversion: 2.1 time: 0.135892 May 27 15:13:08.694652 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 61/137] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:13:08 2022] DELETE /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:13:08.702795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.703407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.710426 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.710881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.711855 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.712294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.903043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.911202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-42388975-a5ba-465d-a19a-c5e088eb8e13 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1553 microversion: 2.1 time: 0.212222 May 27 15:13:08.911886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 77/138] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:09.463062 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:09.463977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:09.473617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.474091 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.475418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.475855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.594771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:09.595417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:09.602504 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.603187 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.604681 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.605357 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.620847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.635111 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-986f9eee-c0df-46e3-be6c-bd0209a0b336 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.176952 May 27 15:13:09.641849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 62/139] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:09 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:09.770653 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.778685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5b3b12ab-0b9b-4e92-987b-438effbe11a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1367 microversion: 2.1 time: 0.188129 May 27 15:13:09.779376 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 78/140] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:09 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:09.929590 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:09.930215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:09.936334 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.936828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.937601 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.938048 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.075022 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.083120 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b10b030a-04f4-4a7b-8899-51bee56846c6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1553 microversion: 2.1 time: 0.158228 May 27 15:13:10.083689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 63/141] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:09 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:10.653907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:10.655187 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:10.667212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.669156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.669975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.670431 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.750940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:10.795955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:10.796604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:10.806257 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.806715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.807495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.807935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.857275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:11.071958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.075200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1b5672f9-b6c3-4407-a26c-7652ccd21094 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.425045 May 27 15:13:11.079688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 79/142] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:10 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:11.100401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.102676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:11.103306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:11.111316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-57c9f59a-8be9-498f-af28-bdb1c21d3f90 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1557 microversion: 2.1 time: 0.319611 May 27 15:13:11.111896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 64/143] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:10 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1557 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:11.112930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.113876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.114671 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.115792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.137720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:11.138967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:11.145197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.145663 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.147307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.147852 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.270619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f38665ca-c6cf-40b2-9a48-18ba78397929 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143889 May 27 15:13:11.279433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 65/144] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:13:11 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:11.977337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.996680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b3eca1d-7c78-428d-9381-51515309a38c tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1553 microversion: 2.1 time: 0.899299 May 27 15:13:12.009960 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 80/145] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:11 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1553 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:12.096548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:12.097348 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:12.111963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.112884 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:12.114948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.116428 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:12.638163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:12.653899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-65bfd945-99e4-4a27-a611-237b79cb0054 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.555036 May 27 15:13:12.660187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 66/146] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:12 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:13.018727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:13.019967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:13.035303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.035772 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.036971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.041738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.245816 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.264718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff6cacfb-5da5-4b06-8b6c-182b64161df1 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1511 microversion: 2.1 time: 0.245668 May 27 15:13:13.264827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-f597cb8e-f29d-4ec9-88d4-3b3451a2c22d req-985763fe-f9d5-472b-a15b-92e5a3072852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f59e3-72be-4164-9117-b85ea68221c0", "name": "network-vif-deleted", "tag": "759aef94-0828-4004-85eb-9b3aee7fc1c0"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:13.266313 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 81/147] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:13 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:13.270506 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f597cb8e-f29d-4ec9-88d4-3b3451a2c22d req-985763fe-f9d5-472b-a15b-92e5a3072852 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.270951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f597cb8e-f29d-4ec9-88d4-3b3451a2c22d req-985763fe-f9d5-472b-a15b-92e5a3072852 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.285899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-f597cb8e-f29d-4ec9-88d4-3b3451a2c22d req-985763fe-f9d5-472b-a15b-92e5a3072852 service nova] Creating event network-vif-deleted:759aef94-0828-4004-85eb-9b3aee7fc1c0 for instance 3f5f59e3-72be-4164-9117-b85ea68221c0 on hv-cinder-84254 May 27 15:13:13.306566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-f597cb8e-f29d-4ec9-88d4-3b3451a2c22d req-985763fe-f9d5-472b-a15b-92e5a3072852 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039487 May 27 15:13:13.309058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 67/148] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:13.666268 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:13.666877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:13.676687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.679295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.683498 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.684124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.963845 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.973360 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-494bdcea-eb6a-4483-9316-7d05c6b3cb96 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.311644 May 27 15:13:13.976988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 82/149] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:13 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:14.275322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:14.277354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:14.285877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.286717 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.288308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.289240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.332689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.333306 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.334446 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lazy-loading 'fault' on Instance uuid 3f5f59e3-72be-4164-9117-b85ea68221c0 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:13:14.422184 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2f8a02c0ee46029b08a31d7ee9eec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef917e1df4a64838aba088201ddb8552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:14.432528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d340bb8d-9c36-41ff-a5a9-f98e333263d0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 200 len: 1351 microversion: 2.1 time: 0.162317 May 27 15:13:14.433475 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 68/150] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:14 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 1351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:14.996252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:14.997464 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:15.003890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.004349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.005170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.005620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.217040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:15.226665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e3e04dbd-5274-4182-93c4-47357d76e58e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.239108 May 27 15:13:15.227767 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 83/151] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:14 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:15.365009 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-e48bac59-9604-4cdb-beba-9515f39b50bf req-6b71ca7f-233f-446f-8e13-608fd90e5d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d00cd5-e391-4c55-a071-152ec1cf4c04", "tag": "806f4f1c-0d26-4fec-be62-86145b66b5e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:15.378343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e48bac59-9604-4cdb-beba-9515f39b50bf req-6b71ca7f-233f-446f-8e13-608fd90e5d16 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.379020 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e48bac59-9604-4cdb-beba-9515f39b50bf req-6b71ca7f-233f-446f-8e13-608fd90e5d16 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.397883 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-e48bac59-9604-4cdb-beba-9515f39b50bf req-6b71ca7f-233f-446f-8e13-608fd90e5d16 service nova] Creating event network-changed:806f4f1c-0d26-4fec-be62-86145b66b5e8 for instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 on hv-cinder-84254 May 27 15:13:15.406613 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-e48bac59-9604-4cdb-beba-9515f39b50bf req-6b71ca7f-233f-446f-8e13-608fd90e5d16 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048229 May 27 15:13:15.407410 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 69/152] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:15.453849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:15.455041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:15.463180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.464049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.465141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.466197 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.502616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] HTTP exception thrown: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Request method failure captured: May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 HTTP/1.1 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpAzm5vOE7jXchcEgqwBi1m4TrsCIUKRNMEwsQGcaswPi8tbWj_AZuLg1nej4e_78FCXXw-QSCO_jtBgp5GMtjmjdWCEFZJnFwfrPCnTVfbi44oF2zBMk0vddbtmtVXeZuem-S911ENEl4HuSoiqJhVlMG2ou3anfikVPp_6RZUFoc May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:13:15.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ef917e1df4a64838aba088201ddb8552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: bf2f8a02c0ee46029b08a31d7ee9eec4 May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.513485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '3f5f59e3-72be-4164-9117-b85ea68221c0'} May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:15.514452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.515799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:15.518295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Returning 404 to user: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:15.518295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d17fa3c7-368e-426f-83bd-b1ff738e12a0 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 404 len: 111 microversion: 2.1 time: 0.069883 May 27 15:13:15.519534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 84/153] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:15 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:15.792314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:15.793675 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:15.801230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.801937 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.804260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.804900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.825400 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] HTTP exception thrown: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Request method failure captured: May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0/os-volume_attachments HTTP/1.1 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpAzm5vOE7jXchcEgqwBi1m4TrsCIUKRNMEwsQGcaswPi8tbWj_AZuLg1nej4e_78FCXXw-QSCO_jtBgp5GMtjmjdWCEFZJnFwfrPCnTVfbi44oF2zBMk0vddbtmtVXeZuem-S911ENEl4HuSoiqJhVlMG2ou3anfikVPp_6RZUFoc May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:13:15.839701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ef917e1df4a64838aba088201ddb8552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: bf2f8a02c0ee46029b08a31d7ee9eec4 May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.841492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'server_id': '3f5f59e3-72be-4164-9117-b85ea68221c0'} May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:15.842164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:15.843272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:15.847508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Returning 404 to user: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:15.848783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-500733db-c164-4873-8f8c-2f5548bcfbf7 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063210 May 27 15:13:15.849371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 70/154] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:13:15 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:13:16.245300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:16.245915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:16.251985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.252471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.253267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.253708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.387348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:16.394961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-25ea8b3c-ba96-44af-9442-046d61476fdf tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.154625 May 27 15:13:16.395523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 85/155] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:16 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:17.054510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:17.055017 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:17.062364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.062821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.063646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.064091 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.077319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] HTTP exception thrown: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Request method failure captured: May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 HTTP/1.1 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpAzm5vOE7jXchcEgqwBi1m4TrsCIUKRNMEwsQGcaswPi8tbWj_AZuLg1nej4e_78FCXXw-QSCO_jtBgp5GMtjmjdWCEFZJnFwfrPCnTVfbi44oF2zBMk0vddbtmtVXeZuem-S911ENEl4HuSoiqJhVlMG2ou3anfikVPp_6RZUFoc May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:13:17.079477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ef917e1df4a64838aba088201ddb8552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: bf2f8a02c0ee46029b08a31d7ee9eec4 May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.080922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '3f5f59e3-72be-4164-9117-b85ea68221c0'} May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:17.081723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.083005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:17.084954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Returning 404 to user: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:17.084954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fc6984ba-30d3-4c39-aa19-b73bf4912ed6 tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 404 len: 111 microversion: 2.1 time: 0.031069 May 27 15:13:17.084954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 71/156] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:13:17 2022] DELETE /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:17.089864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:17.090480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] [instance: 3f5f59e3-72be-4164-9117-b85ea68221c0] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:17.096716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.097170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.097933 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.098375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.116653 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] HTTP exception thrown: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Request method failure captured: May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 HTTP/1.1 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpAzm5vOE7jXchcEgqwBi1m4TrsCIUKRNMEwsQGcaswPi8tbWj_AZuLg1nej4e_78FCXXw-QSCO_jtBgp5GMtjmjdWCEFZJnFwfrPCnTVfbi44oF2zBMk0vddbtmtVXeZuem-S911ENEl4HuSoiqJhVlMG2ou3anfikVPp_6RZUFoc May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:13:17.119747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ef917e1df4a64838aba088201ddb8552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ef917e1df4a64838aba088201ddb8552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: ef917e1df4a64838aba088201ddb8552 May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-DeleteServersTestJSON-2104627198 May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: bf2f8a02c0ee46029b08a31d7ee9eec4 May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-DeleteServersTestJSON-2104627198-project May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.121204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '3f5f59e3-72be-4164-9117-b85ea68221c0'} May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:17.122008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. May 27 15:13:17.123299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:17.124465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] Returning 404 to user: Instance 3f5f59e3-72be-4164-9117-b85ea68221c0 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:17.124465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f99b6582-eefd-4fdf-b007-8079215c45bd tempest-DeleteServersTestJSON-2104627198 tempest-DeleteServersTestJSON-2104627198-project] 10.222.0.41 "GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0" status: 404 len: 111 microversion: 2.1 time: 0.035982 May 27 15:13:17.124465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 86/157] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:17 2022] GET /compute/v2.1/servers/3f5f59e3-72be-4164-9117-b85ea68221c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:17.416501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:17.417158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:17.423524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.423983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.424786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.425226 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.650428 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:17.658903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4d6037c9-8565-48fc-a371-cd65a0129185 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.246679 May 27 15:13:17.659514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 72/158] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:17 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:18.676338 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:18.676913 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:18.683203 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:18.683656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.684561 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:18.684995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.843070 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:18.850810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b7179238-7faa-4b20-afef-1bfe28e9ed42 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.178361 May 27 15:13:18.851570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 87/159] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:18 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:19.056119 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-219e1a85-8469-4100-bc2d-d335d0431acb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Action: 'create', calling method: .version_select at 0x7fa3729408b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2004415748"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:19.344166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-219e1a85-8469-4100-bc2d-d335d0431acb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.410511 May 27 15:13:19.344885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 73/160] 10.222.0.41 () {60 vars in 1154 bytes} [Fri May 27 15:13:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 412 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 15:13:19.356542 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fbe8dbfc-cade-4a88-8d99-6ab4abfcff39 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa37213fb80>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:19.409328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fbe8dbfc-cade-4a88-8d99-6ab4abfcff39 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 200 len: 345 microversion: 2.1 time: 0.056328 May 27 15:13:19.409903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 88/161] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:13:19 2022] GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:19.868898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:19.869831 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:19.877106 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.877568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:19.878548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.878999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:20.104684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:20.120061 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1b7f8bf4-c95f-4af3-8e39-b81a6f6e48e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.256081 May 27 15:13:20.120747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 74/162] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:19 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:20.422801 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32218f32-dedf-4192-9f03-f588a1d9b088 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3720dd670>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:20.473210 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32218f32-dedf-4192-9f03-f588a1d9b088 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 200 len: 346 microversion: 2.1 time: 0.054441 May 27 15:13:20.473976 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 89/163] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:13:20 2022] GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:20.486401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d26a2300-7d87-4498-87af-1018299007c2 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Action: 'create', calling method: .version_select at 0x7fa372940b80>, body: {"snapshot": {"volume_id": "c63f0287-76e9-40d3-b219-b1ac474a9226", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-931207505"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:20.655165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d26a2300-7d87-4498-87af-1018299007c2 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.173255 May 27 15:13:20.655760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 75/164] 10.222.0.41 () {60 vars in 1161 bytes} [Fri May 27 15:13:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:20.667878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-648b1562-b796-47ce-bae4-e48444abf1b1 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3720dd550>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:20.700396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-648b1562-b796-47ce-bae4-e48444abf1b1 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.036876 May 27 15:13:20.705506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 90/165] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:20 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:20.712117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b55d6099-cd49-4ae6-a996-d0721a5124db tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3728e3ca0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:20.743945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b55d6099-cd49-4ae6-a996-d0721a5124db tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036820 May 27 15:13:20.744560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 76/166] 10.222.0.41 () {58 vars in 1139 bytes} [Fri May 27 15:13:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:20.755783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d25aa391-a20d-4742-9be2-22fa89d9eb09 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3721ff4c0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:20.787307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d25aa391-a20d-4742-9be2-22fa89d9eb09 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.034634 May 27 15:13:20.788616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 91/167] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:20 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:21.140327 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:21.141645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:21.148347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:21.148973 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:21.149701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:21.150149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:21.304218 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:21.312012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0b10ce36-f92d-4b9e-9fce-eceb02c67517 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.176277 May 27 15:13:21.312611 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 77/168] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:21 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:21.798997 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ae256f50-3720-47a5-8e60-4933c5134a77 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3720ddee0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:21.829626 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ae256f50-3720-47a5-8e60-4933c5134a77 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.034380 May 27 15:13:21.830197 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 92/169] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:21 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:22.329228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:22.330393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:22.338566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.339138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.339919 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.340542 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.499337 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:22.509088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6e6cbd2c-18f4-4ce8-ba4a-52e3ef362216 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.183349 May 27 15:13:22.509993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 78/170] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:22 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:22.841661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f4679673-a6aa-496e-b8b1-14184245a1ce tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3720dd700>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:22.872490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f4679673-a6aa-496e-b8b1-14184245a1ce tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.035042 May 27 15:13:22.873057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 93/171] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:22 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:23.527741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:23.528356 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:23.534757 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:23.535210 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:23.535978 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:23.536420 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:23.669084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:23.676529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f4ed1568-5be9-4db8-b3d7-8e51680525e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.152897 May 27 15:13:23.677096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 79/172] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:23 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:23.884240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a32b5d72-f202-4a3f-90f5-8ace0b5683bc tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa37213fd30>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:23.913648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a32b5d72-f202-4a3f-90f5-8ace0b5683bc tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 287 microversion: 2.1 time: 0.034093 May 27 15:13:23.914205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 94/173] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:23 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:23.925919 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-45f02877-1664-4839-b400-635931291224 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa37293d160>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:23.991841 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-45f02877-1664-4839-b400-635931291224 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 202 len: 0 microversion: 2.1 time: 0.070712 May 27 15:13:23.992429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 80/174] 10.222.0.41 () {58 vars in 1253 bytes} [Fri May 27 15:13:23 2022] DELETE /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:13:24.000707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be5cee81-d3d5-4696-902c-3bb93f691519 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3722b8d30>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:24.031437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be5cee81-d3d5-4696-902c-3bb93f691519 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.034736 May 27 15:13:24.031995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 95/175] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:23 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:24.695322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:24.696186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:24.702966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.703414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.704188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.704656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.900151 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:24.910478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bcfd6f72-5ac3-4f0e-ada2-e6c2888fc2b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.220847 May 27 15:13:24.920127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 81/176] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:24 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:25.044852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-65783cc6-23d2-4e50-9503-6657dcc0ea9b tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa37213fe50>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.077250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-65783cc6-23d2-4e50-9503-6657dcc0ea9b tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 200 len: 286 microversion: 2.1 time: 0.037069 May 27 15:13:25.080616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 96/177] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:25 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:25.927553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.928224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:25.935296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.935753 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.936556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.937003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.088888 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.092675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca20b6b3-6a65-45cf-adb8-70302dd66784 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3721ff550>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.098191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c2ea4100-a298-49c2-9417-913999363b8e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.174510 May 27 15:13:26.098967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 82/178] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:25 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:26.121909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-ca20b6b3-6a65-45cf-adb8-70302dd66784 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] HTTP exception thrown: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca20b6b3-6a65-45cf-adb8-70302dd66784 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Request method failure captured: May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c HTTP/1.1 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOqOs9APoNPjzKX3AUGzbkaZfgGUBjV2XnXVzM683mPuYMo4i9vSZAOmedtIhGaDrHB2W4OZs4qoDndErT29JW6T_uCJQFboUuEKvyljISX42riXpTXkUgRX1jj19yG-wyOqzWM87cWsLzyk-cPnAE-NJCFj_WcEDe5Rs9b9zTFLeck May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:13:26.124793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_706aa1db9c854954912661850ca7d9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d67e4e9573514ffc91815c90e72cf9fa May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '57820d35-f5dd-4e61-93ce-e0e82df60f8c'} May 27 15:13:26.127358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. (HTTP 404) (Request-ID: req-16aa71bf-6dfb-4e3f-92cf-efda91e333fa) May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.128959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:26.131446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 15:13:26.134337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ca20b6b3-6a65-45cf-adb8-70302dd66784 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Returning 404 to user: Snapshot 57820d35-f5dd-4e61-93ce-e0e82df60f8c could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ca20b6b3-6a65-45cf-adb8-70302dd66784 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c" status: 404 len: 111 microversion: 2.1 time: 0.037764 May 27 15:13:26.137035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 97/179] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/os-snapshots/57820d35-f5dd-4e61-93ce-e0e82df60f8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:26.140526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-050057c6-8eb9-4828-bc4b-009c1227f254 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3728f8430>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.212513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-050057c6-8eb9-4828-bc4b-009c1227f254 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 202 len: 0 microversion: 2.1 time: 0.079490 May 27 15:13:26.213286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 83/180] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:13:26 2022] DELETE /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:13:26.223096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf6025d7-017c-4875-9db3-36d129acc9c8 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa372afcd30>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.281262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf6025d7-017c-4875-9db3-36d129acc9c8 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 200 len: 345 microversion: 2.1 time: 0.062788 May 27 15:13:26.281863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 98/181] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:27.120244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.120895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:27.126951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.127406 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.128175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.128650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.265629 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.275355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0b2aadac-e1b0-4d43-9e8e-a62507b9b0f2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.159351 May 27 15:13:27.275932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 84/182] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:27.293961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6eb57a82-0d03-4ab3-8c1f-6512a5782ddb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa37213f9d0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.343615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-6eb57a82-0d03-4ab3-8c1f-6512a5782ddb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] HTTP exception thrown: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6eb57a82-0d03-4ab3-8c1f-6512a5782ddb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Request method failure captured: May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 HTTP/1.1 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOqOs9APoNPjzKX3AUGzbkaZfgGUBjV2XnXVzM683mPuYMo4i9vSZAOmedtIhGaDrHB2W4OZs4qoDndErT29JW6T_uCJQFboUuEKvyljISX42riXpTXkUgRX1jj19yG-wyOqzWM87cWsLzyk-cPnAE-NJCFj_WcEDe5Rs9b9zTFLeck May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:13:27.346000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_706aa1db9c854954912661850ca7d9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d67e4e9573514ffc91815c90e72cf9fa May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'c63f0287-76e9-40d3-b219-b1ac474a9226'} May 27 15:13:27.347181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. (HTTP 404) (Request-ID: req-6547b472-66c6-451d-bc1d-17cecb54578e) May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.348009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:27.349049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:13:27.350240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6eb57a82-0d03-4ab3-8c1f-6512a5782ddb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Returning 404 to user: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:27.351221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6eb57a82-0d03-4ab3-8c1f-6512a5782ddb tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 404 len: 109 microversion: 2.1 time: 0.059211 May 27 15:13:27.352400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 99/183] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:13:27.366963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-736f38fe-4a0b-43db-9849-449ac51afb03 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3728f8430>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.409425 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-736f38fe-4a0b-43db-9849-449ac51afb03 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] HTTP exception thrown: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-736f38fe-4a0b-43db-9849-449ac51afb03 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Request method failure captured: May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 HTTP/1.1 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOqOs9APoNPjzKX3AUGzbkaZfgGUBjV2XnXVzM683mPuYMo4i9vSZAOmedtIhGaDrHB2W4OZs4qoDndErT29JW6T_uCJQFboUuEKvyljISX42riXpTXkUgRX1jj19yG-wyOqzWM87cWsLzyk-cPnAE-NJCFj_WcEDe5Rs9b9zTFLeck May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:13:27.413175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_706aa1db9c854954912661850ca7d9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: d67e4e9573514ffc91815c90e72cf9fa May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'c63f0287-76e9-40d3-b219-b1ac474a9226'} May 27 15:13:27.414646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. (HTTP 404) (Request-ID: req-aa76e346-8114-429e-a31c-3515f14c486f) May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:27.417480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:13:27.418927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-736f38fe-4a0b-43db-9849-449ac51afb03 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Returning 404 to user: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-736f38fe-4a0b-43db-9849-449ac51afb03 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 404 len: 109 microversion: 2.1 time: 0.052953 May 27 15:13:27.420435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 85/184] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:13:27 2022] DELETE /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:27.426659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77b5146c-9a51-445c-b64b-c323f5a41d51 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Calling method '.version_select at 0x7fa3720dd160>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.463035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-77b5146c-9a51-445c-b64b-c323f5a41d51 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] HTTP exception thrown: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77b5146c-9a51-445c-b64b-c323f5a41d51 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Request method failure captured: May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 HTTP/1.1 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOqOs9APoNPjzKX3AUGzbkaZfgGUBjV2XnXVzM683mPuYMo4i9vSZAOmedtIhGaDrHB2W4OZs4qoDndErT29JW6T_uCJQFboUuEKvyljISX42riXpTXkUgRX1jj19yG-wyOqzWM87cWsLzyk-cPnAE-NJCFj_WcEDe5Rs9b9zTFLeck May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:13:27.467080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_706aa1db9c854954912661850ca7d9e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/706aa1db9c854954912661850ca7d9e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 706aa1db9c854954912661850ca7d9e3 May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453624400 May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d67e4e9573514ffc91815c90e72cf9fa May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453624400-project May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'c63f0287-76e9-40d3-b219-b1ac474a9226'} May 27 15:13:27.468784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. (HTTP 404) (Request-ID: req-2f8d8930-a241-4e6f-897c-6c36fcef317b) May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.469515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:27.470481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:13:27.472437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-77b5146c-9a51-445c-b64b-c323f5a41d51 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] Returning 404 to user: Volume c63f0287-76e9-40d3-b219-b1ac474a9226 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-77b5146c-9a51-445c-b64b-c323f5a41d51 tempest-VolumesSnapshotsTestJSON-453624400 tempest-VolumesSnapshotsTestJSON-453624400-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226" status: 404 len: 109 microversion: 2.1 time: 0.047369 May 27 15:13:27.475531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 100/185] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/os-volumes/c63f0287-76e9-40d3-b219-b1ac474a9226 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:28.292624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.293989 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:28.300546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.300998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.301776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.302692 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.463485 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.473535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-94ccbda3-958a-4326-818e-9672c3e3fdde tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.185136 May 27 15:13:28.483216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 86/186] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:29.488476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=53 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:29.489360 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=42 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:29.493733 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:29.494925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:29.506923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.507650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.508999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.509576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.666482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:29.679660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3766fa50-25a8-4e71-a999-98380328b58a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.188729 May 27 15:13:29.679660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 101/187] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:29 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:30.693513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:30.694135 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:30.700921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.701401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.702188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.702636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.845916 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.854080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-540db457-6838-4325-be8f-311f38ed5d3b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.164442 May 27 15:13:30.854651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 87/188] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:30 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:31.871079 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:31.871764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:31.877915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.878429 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.879255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.879755 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.005085 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:32.012691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4293e50f-86ff-4d00-8495-a73157cea574 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.145335 May 27 15:13:32.013253 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 102/189] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:31 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:33.029513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:33.030126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:33.032606 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:33.039060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.039517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.040323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.040799 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.173894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:33.182866 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e27a8c8c-025e-4819-a7b3-221c40ce410a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.157156 May 27 15:13:33.183458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 88/190] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:33 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:34.199516 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:34.200125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:34.206604 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.207280 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.208271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.209668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.351255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.358691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-26a56007-9c58-4f9d-9475-34878a9a44f8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.162968 May 27 15:13:34.359254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 103/191] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:34 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:35.375142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.375746 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.383614 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.384058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.385049 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.385797 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.403246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=100 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:35.528637 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.536432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f79065ea-e4fc-4842-a671-da7fe818a2e5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.165178 May 27 15:13:35.537615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 89/192] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:35 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:36.555501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:36.556176 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:36.562113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.562560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:36.563344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.563779 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:36.706885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:36.716126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9e833530-e1e4-49da-b988-ee214e542ada tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.165850 May 27 15:13:36.716796 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 104/193] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:36 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:37.733442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:37.734289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:37.741256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:37.741711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.742543 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:37.743026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.908099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.919422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-24535e7c-1f87-44e2-af2e-8d612f7896dc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.190594 May 27 15:13:37.920528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 90/194] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:37 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:38.939193 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:38.939926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:38.965102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.965654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.966903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.967492 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:39.112050 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:39.120126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d410858c-fef5-4b58-b23b-861a7eb2b43a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.186695 May 27 15:13:39.120775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 105/195] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:38 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:40.136962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:40.137594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:40.144054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.144560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.145338 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.146007 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.283776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.292019 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fa52ab93-a837-404a-8cce-e25b07e3c873 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.158849 May 27 15:13:40.292615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 91/196] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:40 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:41.309230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:41.309982 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:41.316083 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:41.316643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:41.317414 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:41.318698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:41.669325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:41.677201 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fca06c78-fa09-4e0c-9991-20bb0369e342 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.371902 May 27 15:13:41.677695 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 106/197] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:41 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:42.693736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:42.694306 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:42.700801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.701508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.702539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.703154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.852249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.860925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-03b61fd3-f0dd-461b-8270-594b3fda7cdc tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.171372 May 27 15:13:42.861596 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 92/198] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:42 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:43.878722 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:43.879329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:43.885628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.886079 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.886843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.887283 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:44.014871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:44.022639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe2fa3fc-51c3-47aa-b73f-965129e47d7d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.147967 May 27 15:13:44.023180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 107/199] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:43 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:45.039233 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:45.039773 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:45.046282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:45.046737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:45.047502 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:45.047942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:45.178591 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:45.186278 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-14f81356-7dfd-4561-9f82-a0987942c060 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.151077 May 27 15:13:45.186848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 93/200] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:45 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:46.204116 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:46.205096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:46.211064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:46.211539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:46.212290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:46.212778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:46.350985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:46.358828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11cae485-65f5-4d29-8bc7-0207f090f668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.158591 May 27 15:13:46.359398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 108/201] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:46 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:47.375189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:47.375864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:47.382849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.383303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.384082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.384551 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.521489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:47.529010 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8d70149c-6be7-41ea-b6f5-79e4f5f82b9f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.157907 May 27 15:13:47.529576 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 94/202] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:47 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:48.548495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:48.549150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:48.556180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.556715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.557513 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.557988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.684043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:48.691792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d924d62-bbf0-4e0c-b7ad-a7cf135d5e57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.147250 May 27 15:13:48.692545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 109/203] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:48 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:49.709431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:49.709944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:49.716808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:49.717254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:49.718004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:49.718438 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:49.849453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:49.856792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b272e3b2-aa49-452f-b8b1-ebcaa9de8c57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.152201 May 27 15:13:49.857354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 95/204] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:49 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:50.874322 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:50.874935 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:50.881081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:50.881534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:50.882296 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:50.882740 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:51.012793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:51.020132 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5e944efb-787f-40c1-a11b-947b79acf0a3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.149601 May 27 15:13:51.021324 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 110/205] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:50 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:52.038112 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:52.038746 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:52.045412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:52.045858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:52.046613 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:52.047051 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:52.174468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:52.182788 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b79ec8c5-20a3-45cf-b218-f287d2b032fb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1522 microversion: 2.1 time: 0.149318 May 27 15:13:52.183343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 96/206] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:52 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:53.199682 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:53.200242 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:53.207143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:53.207596 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:53.208387 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:53.208856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:53.342256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:53.352913 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5db4388e-1b7e-45cb-9a16-093f2f7ce88e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1502 microversion: 2.1 time: 0.156893 May 27 15:13:53.353737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 111/207] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:53 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:53.375582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:53.376874 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:53.384081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:53.384569 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:53.385352 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:53.385787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:53.532850 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:53.543962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9a9b336c-1315-45a7-acd8-dfef035c5234 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1514 microversion: 2.1 time: 0.172760 May 27 15:13:53.544901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 97/208] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:53 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:58.107967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:58.109081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:58.116316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:58.116900 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:58.117911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:58.118418 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:58.143037 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lazy-loading 'flavor' on Instance uuid 4e89d631-1962-4ed9-a49a-96fe0948d096 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:13:58.258391 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-33999acc-ea51-4b05-9a14-fe22cb07c34e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/action" status: 200 len: 32 microversion: 2.1 time: 0.155416 May 27 15:13:58.260299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 112/209] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:13:58 2022] POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:13:58.269180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:58.269825 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:58.281621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:58.281999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:58.289786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:58.290253 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:58.568436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:58.577801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a8222c59-ea5a-4a09-8c0c-c434467058cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.312347 May 27 15:13:58.579153 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 98/210] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:58 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:59.597253 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:59.597955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:59.600132 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=25 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:59.605698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:59.606156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:59.607028 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:59.607475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:59.610292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:59.738691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:59.746969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-549e0556-7d30-4b09-8c11-dfcec0e17d8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.153869 May 27 15:13:59.747565 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 113/211] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:13:59 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:00.764748 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:00.765286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:00.772584 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:00.773031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:00.773788 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:00.774224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:00.904058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:00.912491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f6e949fd-362b-4233-bff6-684801de1162 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.151690 May 27 15:14:00.913066 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 99/212] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:00 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:01.930015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:01.930619 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:01.936689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:01.937145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:01.937898 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:01.938334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:02.064346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:02.071951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c70360cf-5937-4cd2-9754-e76249b16f6f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.146599 May 27 15:14:02.072527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 114/213] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:01 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:03.088801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:03.089470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:03.092026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=24 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:03.097523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:03.097984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:03.098794 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:03.099355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:03.230442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:03.237843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e696b0cf-a4af-4aaf-9a62-866ba1dfa753 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.152997 May 27 15:14:03.238410 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 100/214] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:03 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:04.255599 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:04.256161 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:04.262337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:04.262793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:04.263559 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:04.264009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:04.396361 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:04.403797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-006dd76d-d197-4f81-abae-75a1b916b591 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.152712 May 27 15:14:04.404348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 115/215] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:04 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:05.420681 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:05.421330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:05.428594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:05.429104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:05.429914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:05.430354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:05.434284 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=70 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:05.561521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:05.568866 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a4559cf4-5bd7-4bed-9083-db4bb03638c2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.151978 May 27 15:14:05.569471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 101/216] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:05 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:06.586403 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:06.587005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:06.593319 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:06.593881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:06.594655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:06.595098 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:06.738633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:06.746360 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-db47b142-285b-493b-b573-9d446287e5bd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.164440 May 27 15:14:06.746989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 116/217] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:06 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:07.763009 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:07.763624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:07.770106 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:07.770558 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:07.771325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:07.771806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:07.900617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:07.908283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-294841a1-ee1b-4b5d-8fba-72b1d5de2b31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.149092 May 27 15:14:07.908876 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 102/218] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:07 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:08.925452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:08.926056 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:08.932384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.932863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.933618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.934054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:09.061038 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:09.068370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-63cee079-143c-422a-a0ab-3e5bedd2353d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.146780 May 27 15:14:09.068998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 117/219] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:08 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:10.084819 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:10.085427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:10.092019 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.092491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:10.093248 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.093684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:10.233603 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:10.242004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e1ea3b50-a9a0-4e68-bc08-a2bd353c58e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.161320 May 27 15:14:10.242595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 103/220] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:10 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:11.258827 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:11.259384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:11.265341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:11.265784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.266530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:11.266958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.406943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:11.414775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-63ee7bca-847b-4beb-94a6-30e09c6629e2 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.160464 May 27 15:14:11.415460 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 118/221] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:11 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:12.431969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:12.432617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:12.439009 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.439450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.440203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.440669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.580498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:12.589254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9c68ae49-d7b1-4e3e-941f-24bd5b7064d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.162153 May 27 15:14:12.589915 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 104/222] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:12 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:13.606124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:13.607295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:13.613367 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:13.613809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:13.614739 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:13.616004 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:13.807845 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:13.820321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-61b3c71d-8107-4331-a684-8ddff4c00e1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.218613 May 27 15:14:13.820919 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 119/223] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:13 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:14.838300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:14.838921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:14.846034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.846478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.847239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.847685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.981672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:14.989594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-242169f8-fddd-4c86-8224-12dddd54678a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.155853 May 27 15:14:14.990162 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 105/224] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:14 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:16.006956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:16.007573 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:16.015680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.016550 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.017329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.017771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.193955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:16.202605 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21c49a52-f6b7-41f7-be87-a26c15aa5627 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.199362 May 27 15:14:16.204038 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 120/225] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:16 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:17.230735 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:17.231201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:17.237534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:17.237985 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:17.238742 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:17.239175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:17.379522 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:17.391795 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f49eb698-1685-4b68-b44d-0f4a35a243c6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.164836 May 27 15:14:17.392403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 106/226] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:17 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:18.409276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:18.409978 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:18.416164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:18.416663 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:18.417463 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:18.417904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:18.546240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:18.554381 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e174037d-3aaf-49f2-a226-cbbddce79b7e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.149077 May 27 15:14:18.554937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 121/227] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:18 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:19.570837 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:19.571487 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:19.577958 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:19.578421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:19.579200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:19.579620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:19.714319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:19.722457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bce4fb46-2a1d-49f6-b8db-ef2eb52567cb tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.155473 May 27 15:14:19.723030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 107/228] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:19 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:20.739147 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:20.739776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:20.746408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:20.747009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:20.747781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:20.748229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:20.885318 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:20.893854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60f2afae-edc3-463c-b114-abd2c9ebd078 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.158751 May 27 15:14:20.894455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 122/229] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:20 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:21.910259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:21.911088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:21.918323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:21.918978 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:21.919908 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:21.920345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.067597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:22.075719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-89ad11b8-e7c0-4972-a06b-5ece5768dcb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.169339 May 27 15:14:22.076490 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 108/230] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:21 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:22.136966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:22.138133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:22.145118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.145906 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.147455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.148065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.178709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75dad654-d671-455f-8d9b-59272e9db3ef tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/ips" status: 200 len: 144 microversion: 2.1 time: 0.046193 May 27 15:14:22.179617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 123/231] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:14:22 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/ips => generated 144 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:22.219305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:22.220145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:22.230294 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.234205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.235323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.235938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.261142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-81359530-8561-42a7-b51c-90417e737f88 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/ips" status: 200 len: 150 microversion: 2.1 time: 0.047236 May 27 15:14:22.261969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 109/232] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:14:22 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:23.094082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:23.094913 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:23.103688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:23.104483 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:23.106087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:23.106751 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:23.311766 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:23.320523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-69c5621d-b602-4916-9f37-431da3449ff9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.230788 May 27 15:14:23.321026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 124/233] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:23 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:24.337913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:24.338710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:24.345353 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:24.345808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:24.346575 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:24.347013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:24.536228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:24.546616 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7841d527-1eca-4332-af53-3394ca42b729 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.213098 May 27 15:14:24.547178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 110/234] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:24 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:25.207375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f6596a-4c63-43f6-98c5-ef26d4edd71d"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:25.209112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:25.215475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.216229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.217023 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.217500 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.563997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:25.564641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:25.571748 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.572202 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.573001 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.573444 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.919350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:25.947744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-803e768b-5e4f-498d-bfdc-866a5da8bb35 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.385907 May 27 15:14:25.948579 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 111/235] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:25 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:25.954904 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c5c1d2-b544-476b-b85f-87068da26a62"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:25.956335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:25.963745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.964398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.965707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.966409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.491272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-aa2a3ca1-3b33-4423-9edd-7cf8c335ed82 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540823 May 27 15:14:26.492392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 112/236] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:14:25 2022] POST /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:26.586135 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-df30dfc6-5b5f-4f0a-b9ce-3569f14820b0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.383777 May 27 15:14:26.588108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 125/237] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:14:25 2022] POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments => generated 194 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:26.963519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:26.964107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:26.971033 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.971479 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.972232 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.972745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.111651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:27.119625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-786c2da1-2008-4acd-a60a-bfead9974183 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.160489 May 27 15:14:27.120183 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 113/238] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:26 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:28.139094 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:28.139796 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.146071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.146462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.147224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.148320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.289952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:28.298618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-163bacb5-8dac-491c-9127-132a0183b52f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1500 microversion: 2.1 time: 0.164141 May 27 15:14:28.299188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 126/239] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:28 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:28.315640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff0910f-e4bb-4e24-b594-af95e8737c9c"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:28.316833 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.324293 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.324792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.325568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.326017 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.349307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e89d631-1962-4ed9-a49a-96fe0948d096 while it is in vm_state rescued May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Request method failure captured: May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/os-volume_attachments HTTP/1.1 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 74 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpQpBZVsnDGdmplgtPlCdPQTocc2RyKQ4d1DmoYtpJSdgBDsLpH6sl-lhrkSjw-E_5andgJQY03fKCKoS3_grQxWDdY8VlXgOScqFJveXHANQhMgcEMoFaZvsszy18OseTJXCEc9IAjFe2oi-7k9QujihxLsLHnPiVkgycx8GTQZTg May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: c162124048a34243867e236c81a70eb0 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:14:28.351096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c162124048a34243867e236c81a70eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c162124048a34243867e236c81a70eb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: c162124048a34243867e236c81a70eb0 May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: d25dc63e8a4c4af8af2fe29b7819212b May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {"volumeAttachment": {"volumeId": "bff0910f-e4bb-4e24-b594-af95e8737c9c"}} May 27 15:14:28.352689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Cannot 'attach_volume' instance 4e89d631-1962-4ed9-a49a-96fe0948d096 while it is in vm_state rescued May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'server_id': '4e89d631-1962-4ed9-a49a-96fe0948d096', 'body': {'volumeAttachment': {'volumeId': 'bff0910f-e4bb-4e24-b594-af95e8737c9c'}}} May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:28.353491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4e89d631-1962-4ed9-a49a-96fe0948d096 while it is in vm_state rescued May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:28.354780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4e89d631-1962-4ed9-a49a-96fe0948d096 while it is in vm_state rescued May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Returning 409 to user: Cannot 'attach_volume' instance 4e89d631-1962-4ed9-a49a-96fe0948d096 while it is in vm_state rescued {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c202bdfb-d551-4867-981d-f596b6d27c58 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040940 May 27 15:14:28.356002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 114/240] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:14:28 2022] POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:14:28.361549 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:28.362163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.368745 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.369200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.369957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.370399 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.438999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:28.452986 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-495217f8-6547-47c5-9594-689c7c698b3a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/action" status: 202 len: 0 microversion: 2.1 time: 0.094693 May 27 15:14:28.454228 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 127/241] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:14:28 2022] POST /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:14:28.463422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:28.464037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.471906 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.472727 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.474089 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.474582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.723980 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:28.733369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b4142a1c-65f2-4445-9473-39622f30ffd1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1508 microversion: 2.1 time: 0.274660 May 27 15:14:28.734439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 115/242] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:28 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:29.752774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:29.754253 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:29.760327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=30 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:29.766900 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:29.767355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:29.768117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:29.768577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:29.932772 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:29.941348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68e3b5ca-d3f4-437a-9afd-64f77ad5ef14 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1508 microversion: 2.1 time: 0.193358 May 27 15:14:29.941927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 128/243] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:29 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:30.959290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:30.960017 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:30.967835 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:30.968414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:30.971573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:30.972142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:31.124037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:31.141990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-179df61d-9e0f-4d73-b005-bc3d23ed6940 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1508 microversion: 2.1 time: 0.186483 May 27 15:14:31.142813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 116/244] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:30 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:32.161328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:32.161869 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:32.169376 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:32.169821 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:32.170576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:32.171007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:32.310509 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:32.318282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c3f89a68-f6a0-427c-afc2-e11852d280e9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1514 microversion: 2.1 time: 0.162146 May 27 15:14:32.318835 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 129/245] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:32 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:33.668000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-82cf4f81-3a40-4ade-89c7-c844d3af3728 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: .version_select at 0x7fa3728f8790>, body: {"keypair": {"name": "tempest-keypair-21880966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrX5b63uP+8Kvm0+DFW5YbCh0vkpF47B5ON2e2l19/Fh9aBOVNLeROmadrNBdV9xu3sw8BKnbKYqpZc398yOw7aKa2GAv2PF0X4FR2siXZ9jwj4YZFotSyjwzz23NCrpQ=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:33.673075 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=34 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:33.686652 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-82cf4f81-3a40-4ade-89c7-c844d3af3728 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for project c162124048a34243867e236c81a70eb0. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:33.690598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-82cf4f81-3a40-4ade-89c7-c844d3af3728 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for user d25dc63e8a4c4af8af2fe29b7819212b and project c162124048a34243867e236c81a70eb0. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:33.713549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-82cf4f81-3a40-4ade-89c7-c844d3af3728 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050302 May 27 15:14:33.714148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 117/246] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:14:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:34.122882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b361b489-3b7e-437a-921a-ec510ed04b8d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: .version_select at 0x7fa3720dd310>, body: {"keypair": {"name": "tempest-keypair-619848697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIS9Viq2ZRsVwsccIjEZ20Hlzgk90CGbaO1HSmUuLd3mu8H2NBRIqf7U7mpiUCcJ9Er8s78Dcw/gX/S30HGo6cfK7vNO5ics/YcO2rQSr0uMJc2k/ye4nmVycgXDET/8g=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:34.139222 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-b361b489-3b7e-437a-921a-ec510ed04b8d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:34.144921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-b361b489-3b7e-437a-921a-ec510ed04b8d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:34.173527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b361b489-3b7e-437a-921a-ec510ed04b8d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061884 May 27 15:14:34.174250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 130/247] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:14:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:35.183947 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-370504114", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5328ba14-6e9c-4898-8e1e-5ccb3a5d834a"}], "security_groups": [{"name": "tempest-securitygroup--1976999593"}], "key_name": "tempest-keypair-21880966", "user_data": "}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:35.740967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1185289567", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25b92ae9-fc97-4437-8dc2-335b8971db2a"}], "security_groups": [{"name": "tempest-securitygroup--2116783785"}], "key_name": "tempest-keypair-619848697", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:40.313827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] validate_networks() for [('5328ba14-6e9c-4898-8e1e-5ccb3a5d834a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:40.317114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] validate_networks() for [('25b92ae9-fc97-4437-8dc2-335b8971db2a', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:40.963088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:40.963596 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:40.964087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:40.964545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:40.965263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:40.967534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:40.967987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:40.968477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:40.968895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:40.969302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:40.974583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.975244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.976756 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.977207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.978987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.979379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.980192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.980655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.989319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:40.994907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:41.000659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:41.002209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:41.006927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Getting quotas for user d25dc63e8a4c4af8af2fe29b7819212b and project c162124048a34243867e236c81a70eb0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:41.014535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:41.017060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:41.020592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:41.023966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:41.071298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3c3e8623-451c-4392-9fb9-4db6a163cf25 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.342942 May 27 15:14:41.072344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 131/248] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:14:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 5344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:41.076727 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c888c144-141e-4a48-926a-473e5ec5b883 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.898757 May 27 15:14:41.078486 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2110725138", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:41.082452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 118/249] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:14:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 5905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:41.088316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d209031e-3c52-42c2-a350-b185e04a64ff tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:41.095342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d209031e-3c52-42c2-a350-b185e04a64ff tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:41.095899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d209031e-3c52-42c2-a350-b185e04a64ff tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:41.167719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d209031e-3c52-42c2-a350-b185e04a64ff tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Going to try to stop instance {{(pid=117641) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:14:41.173520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] validate_networks() for None {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:41.226666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d209031e-3c52-42c2-a350-b185e04a64ff tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action" status: 202 len: 0 microversion: 2.1 time: 0.141841 May 27 15:14:41.227872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 119/250] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:14:41 2022] POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:14:41.233888 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4e6f4f96-956f-475e-b8a5-af35f2e47176 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:41.235225 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4e6f4f96-956f-475e-b8a5-af35f2e47176 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:41.400416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4e6f4f96-956f-475e-b8a5-af35f2e47176 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:41.411550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4e6f4f96-956f-475e-b8a5-af35f2e47176 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1241 microversion: 2.1 time: 0.182260 May 27 15:14:41.412280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 120/251] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:41 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:41.427496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a1aae459-40bf-46be-a714-c2c4d385b812 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:41.428736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a1aae459-40bf-46be-a714-c2c4d385b812 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:41.516119 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a1aae459-40bf-46be-a714-c2c4d385b812 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:41.525267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a1aae459-40bf-46be-a714-c2c4d385b812 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1243 microversion: 2.1 time: 0.111769 May 27 15:14:41.525837 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 121/252] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:41 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1243 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:41.542008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:41.542780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:41.555267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:41.556043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:41.557034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:41.557560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:41.617557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:41.618195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:41.618768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:41.619290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:41.619829 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:41.631498 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:41.632093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:41.636236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:41.636897 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:41.667634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Getting quotas for project b14f7f84a9fa48f0985d0a66332b8f1d. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:41.673340 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Getting quotas for user be6fbb553cee41319831ee8ef63b932e and project b14f7f84a9fa48f0985d0a66332b8f1d. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:41.692878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:41.695401 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:41.726981 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:41.739454 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cfea753e-0de1-4a7d-acde-80a2d79e30e2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.202586 May 27 15:14:41.740681 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 122/253] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:41 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:41.752298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a7c47a63-5ac0-40e6-bcb7-54447b0e30b9 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678821 May 27 15:14:41.753574 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 132/254] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:41.765209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-22cf6cd7-f2eb-416c-b45a-c5ca117df5ef tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:41.766003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-22cf6cd7-f2eb-416c-b45a-c5ca117df5ef tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:41.840943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22cf6cd7-f2eb-416c-b45a-c5ca117df5ef tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:41.848427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-22cf6cd7-f2eb-416c-b45a-c5ca117df5ef tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1215 microversion: 2.1 time: 0.088250 May 27 15:14:41.851013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 123/255] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:41 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:42.429279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:42.430615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:42.436817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.437273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.438036 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.438475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.502045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:42.509484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1f7b06f7-63fb-4085-8b5a-c49c5bc48b3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1293 microversion: 2.1 time: 0.084236 May 27 15:14:42.510039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 133/256] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:42.542808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:42.543488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:42.550762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.551207 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.551972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.552409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.613889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:42.621824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-20f511be-39de-4bf2-97e7-c56db6dbd590 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1303 microversion: 2.1 time: 0.083500 May 27 15:14:42.622523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 124/257] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:42.758666 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:42.759916 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:42.766527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.767224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.768145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.768995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.872745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:42.873341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:42.882880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.887003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.889941 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.891996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.026929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:43.034483 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-000ef90c-923a-4769-b8a2-0cf379c5a205 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1267 microversion: 2.1 time: 0.171091 May 27 15:14:43.036641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 125/258] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:43.063168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:43.071692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5dcc424d-b706-45a0-b684-03bfea575744 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.317627 May 27 15:14:43.072241 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 134/259] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:43.527128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.527739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:43.534113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.534486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.535291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.535731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.639852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.640776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:43.650788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.651337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.652149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.652896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.909638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:43.918251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-743794a2-61d5-4771-87db-a8f3caeb8bd8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1301 microversion: 2.1 time: 0.282500 May 27 15:14:43.920849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:43.944192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3acd2852-f441-4f9b-b83d-c2d35012b64a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1299 microversion: 2.1 time: 0.420603 May 27 15:14:43.953364 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 135/260] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:43 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1301 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:43.958493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 126/261] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:43 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1299 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:44.055304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.056270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:44.063080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.063597 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.064730 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.065246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.089186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.089813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:44.102849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.103246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.105335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.105998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.224517 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:44.235092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe68955c-1ef7-4fdb-b720-ac6c71f4c236 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1273 microversion: 2.1 time: 0.183758 May 27 15:14:44.236165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 136/262] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:44.463520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:44.479129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-59cd8eae-ac67-4efd-9905-fc9d75581b05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.393651 May 27 15:14:44.480112 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 127/263] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:44.837332 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-50f35f77-957b-4ca2-aced-55a04f76b3de req-64f66e0c-45c4-4b78-b55f-64ec98b7405a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ebf9a-c645-4e5f-a78c-99539adcdf08", "tag": "44f4f49a-5397-4f3e-9a8f-8b22ac911f1a"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:44.849939 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-50f35f77-957b-4ca2-aced-55a04f76b3de req-64f66e0c-45c4-4b78-b55f-64ec98b7405a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.850608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-50f35f77-957b-4ca2-aced-55a04f76b3de req-64f66e0c-45c4-4b78-b55f-64ec98b7405a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.873795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-50f35f77-957b-4ca2-aced-55a04f76b3de req-64f66e0c-45c4-4b78-b55f-64ec98b7405a service nova] Creating event network-changed:44f4f49a-5397-4f3e-9a8f-8b22ac911f1a for instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 on hv-cinder-84254 May 27 15:14:44.885726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-50f35f77-957b-4ca2-aced-55a04f76b3de req-64f66e0c-45c4-4b78-b55f-64ec98b7405a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058483 May 27 15:14:44.887011 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 137/264] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.941351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.942607 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:44.950743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.951478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.952440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.953063 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.965520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.966491 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:44.980632 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.983175 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.985726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.987034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.370446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.379450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.380859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b73e211e-bb02-4639-a0c4-3a2fe0f70bf7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.419784 May 27 15:14:45.381569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 138/265] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:45.391533 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.392223 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:45.396854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8427ae58-aef3-459b-ae12-2bd982ba0bb6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.464569 May 27 15:14:45.397411 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 128/266] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:45.399985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.400608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.401698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.402287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.490908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.499300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.500490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3d52b6eb-bcc8-4a5a-8c78-9253539348ed tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1273 microversion: 2.1 time: 0.117518 May 27 15:14:45.500878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:45.507439 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 139/267] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:45.518241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.518701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.519489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.519928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.838858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.848204 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c7259aab-a545-440f-ad14-889dd1ae2653 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.354506 May 27 15:14:45.848880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 129/268] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:46.048759 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9e6f5aa5-fb83-4105-9028-4afd0f1d1439 req-c3bb727a-1318-4e3c-b71c-3c710d33725a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:46.058194 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9e6f5aa5-fb83-4105-9028-4afd0f1d1439 req-c3bb727a-1318-4e3c-b71c-3c710d33725a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.058642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9e6f5aa5-fb83-4105-9028-4afd0f1d1439 req-c3bb727a-1318-4e3c-b71c-3c710d33725a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.074014 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9e6f5aa5-fb83-4105-9028-4afd0f1d1439 req-c3bb727a-1318-4e3c-b71c-3c710d33725a service nova] Creating event network-changed:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:14:46.078758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9e6f5aa5-fb83-4105-9028-4afd0f1d1439 req-c3bb727a-1318-4e3c-b71c-3c710d33725a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033687 May 27 15:14:46.079353 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 140/269] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:46.403636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.403636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.405919 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.406375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.407150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.407588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.414875 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.415579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.421838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.422507 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.423488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.424077 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.816407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:46.825420 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-47ef9f0a-12da-41f6-801d-153a8a57a697 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.414762 May 27 15:14:46.826147 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 141/270] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:46.838305 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.839088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.845646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.846187 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.847031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.847540 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.853855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:46.862843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-52344b28-6357-4c46-9146-8007d567bac6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.468791 May 27 15:14:46.863961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 130/271] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:46.870854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.871715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.879302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.880154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.881478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.882825 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.513516 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:47.521944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d61c2ad7-178e-4ed5-90e9-9c90fbe5d235 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.687967 May 27 15:14:47.522633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 142/272] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:47.552375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:47.564952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e903adf8-c4b7-42bd-a021-cb12c5ace5ce tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.699500 May 27 15:14:47.566033 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 131/273] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:47.842700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:47.843308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:47.850835 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.851310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.852162 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.852638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.880701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:47.882896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:47.893207 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.896646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.897690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.899213 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.157000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:48.174672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-19576a70-10da-4f9b-ae43-4e3d5f8402d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.297750 May 27 15:14:48.176149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 132/274] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:47 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:48.189336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-3cd84e95-e132-4b85-a4da-be267e779ac3 req-faaf3609-2ca1-4bec-b749-b0b4ba99ced3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2", "tag": "c3f1f72a-3e54-4ff0-a70e-71e9e3954a04"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:48.191644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:48.200220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-34e07e2c-950a-4f2e-840e-821a44924441 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.361493 May 27 15:14:48.203763 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-3cd84e95-e132-4b85-a4da-be267e779ac3 req-faaf3609-2ca1-4bec-b749-b0b4ba99ced3 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.205098 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-3cd84e95-e132-4b85-a4da-be267e779ac3 req-faaf3609-2ca1-4bec-b749-b0b4ba99ced3 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.216729 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 143/275] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:47 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:48.232710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-3cd84e95-e132-4b85-a4da-be267e779ac3 req-faaf3609-2ca1-4bec-b749-b0b4ba99ced3 service nova] Creating event network-changed:c3f1f72a-3e54-4ff0-a70e-71e9e3954a04 for instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 on hv-cinder-84254 May 27 15:14:48.238308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-3cd84e95-e132-4b85-a4da-be267e779ac3 req-faaf3609-2ca1-4bec-b749-b0b4ba99ced3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060428 May 27 15:14:48.238838 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 133/276] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:48.539799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.540599 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:48.546471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.547172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.548102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.548415 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.584707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.586349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:48.595822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.596684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.597685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.598155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.005568 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.010762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.020868 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-845e484d-2442-45bc-bfdd-b05c69e28e84 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.484969 May 27 15:14:49.022462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 144/277] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.024854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d9ef8618-139a-458c-8601-434f46df1334 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.442280 May 27 15:14:49.029017 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 134/278] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:49.193585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.196491 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:49.205654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.206181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.207127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.207700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.234597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.236140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:49.244826 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.245645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.246697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.247203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.534358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.541036 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.547196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d544b5ce-d80c-49d0-a13e-cb6e2943e5e3 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.317609 May 27 15:14:49.550367 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e9b6f46-db65-4cfb-9ff7-bd180dacd115 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.361689 May 27 15:14:49.560852 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 135/279] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.562169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 145/280] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.923476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-fbdae617-7220-4b08-b78b-b201bec5b7ae req-6496c621-432a-4c29-bcd9-3fdaf29c2bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ebf9a-c645-4e5f-a78c-99539adcdf08", "name": "network-vif-plugged", "status": "completed", "tag": "44f4f49a-5397-4f3e-9a8f-8b22ac911f1a"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:49.934283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-fbdae617-7220-4b08-b78b-b201bec5b7ae req-6496c621-432a-4c29-bcd9-3fdaf29c2bc9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.934930 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-fbdae617-7220-4b08-b78b-b201bec5b7ae req-6496c621-432a-4c29-bcd9-3fdaf29c2bc9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.947186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-fbdae617-7220-4b08-b78b-b201bec5b7ae req-6496c621-432a-4c29-bcd9-3fdaf29c2bc9 service nova] Creating event network-vif-plugged:44f4f49a-5397-4f3e-9a8f-8b22ac911f1a for instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 on hv-cinder-84254 May 27 15:14:49.952901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-fbdae617-7220-4b08-b78b-b201bec5b7ae req-6496c621-432a-4c29-bcd9-3fdaf29c2bc9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 May 27 15:14:49.953804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 136/281] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:50.041110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.042045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.052792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.053249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.057543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.058032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.061099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.062149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.072637 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.073101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.084417 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.085447 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.308802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:50.319173 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc4b7c6d-8b84-4af3-9ac7-cd977efced69 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.284039 May 27 15:14:50.330488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 146/282] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:50.331636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:50.340367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-697a07ee-b3f3-4d17-a4a5-e5bc71c2e362 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.294091 May 27 15:14:50.341470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 137/283] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:50.568439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.569089 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.575934 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.576691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.588528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.590922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.592486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.593462 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.593919 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.596627 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.597893 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.599659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.963841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:50.985336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-93feb706-8e90-43f9-8958-effbea27bd3b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.422034 May 27 15:14:50.988713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 147/284] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:50.990283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:51.022396 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:51.025080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:51.034889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-23073155-605b-4905-80c7-641208b89980 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.470179 May 27 15:14:51.052353 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 138/285] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.344254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.345272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:51.364275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.365363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:51.382243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.384121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.386267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.386805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.387250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.389352 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.390568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.391012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.399626 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:51.632813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:51.640813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:51.644536 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-053d0be5-0d44-4d02-8292-15f837647a4c tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.311747 May 27 15:14:51.645126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 148/286] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.661964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5bb63e17-7302-40c9-b4db-f72ddb724e02 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.307342 May 27 15:14:51.672694 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 139/287] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:51.967502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:51.968355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=16 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:51.973733 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-126d3bf0-39d1-4d63-bf54-58f966b4696f req-83c6a959-1a82-43af-a6ce-1a27a66a65a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "name": "network-vif-plugged", "status": "completed", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:51.982994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-126d3bf0-39d1-4d63-bf54-58f966b4696f req-83c6a959-1a82-43af-a6ce-1a27a66a65a0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.983443 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-126d3bf0-39d1-4d63-bf54-58f966b4696f req-83c6a959-1a82-43af-a6ce-1a27a66a65a0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.004990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.006221 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.019467 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=16 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:52.026288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-126d3bf0-39d1-4d63-bf54-58f966b4696f req-83c6a959-1a82-43af-a6ce-1a27a66a65a0 service nova] Creating event network-vif-plugged:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:14:52.031014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.031712 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.032690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.034367 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-126d3bf0-39d1-4d63-bf54-58f966b4696f req-83c6a959-1a82-43af-a6ce-1a27a66a65a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067327 May 27 15:14:52.034992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.039622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 149/288] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:52.071195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.072317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.084488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.085335 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.090237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.090689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.315441 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:52.325401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2d57209b-3512-45ae-8ad5-12f5f49bd4bc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1367 microversion: 2.1 time: 0.324025 May 27 15:14:52.326151 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 140/289] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:52.343705 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:52.352484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8081e277-a287-49f9-95b0-14222fb98cd0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.286479 May 27 15:14:52.362373 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 150/290] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:52.662778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.664490 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.682479 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.683621 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.694142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.700183 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.700688 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.708710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.710042 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.710963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.714977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.715455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.338842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.354503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-25394d9f-bd48-46ad-a875-754f641c4d32 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.696455 May 27 15:14:53.355138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 141/291] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.369736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:53.370415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:53.399471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.400320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.401458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.402108 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.406781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.416873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f12a2435-76dd-4612-874e-433db6a487de tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.739599 May 27 15:14:53.421653 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 151/292] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.427677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:53.428789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:53.436951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.437712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.440205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.441214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.656030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.674890 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-70beff85-f278-4162-adb9-b05719d14997 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1556 microversion: 2.1 time: 0.307956 May 27 15:14:53.676321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 142/293] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:53 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1556 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.691687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.694269 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:53.694767 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:53.701748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e2ba7f3c-152d-4f31-b17d-2a081d3feca9 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.278267 May 27 15:14:53.702608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 152/294] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:53 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.708912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.709557 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.711262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.711938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.811724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-08dd7d99-1310-49e2-a12f-6d8943e3a22b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122269 May 27 15:14:53.812336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 143/295] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:14:53 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:54.386381 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:54.387406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:54.397049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.398539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.399675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.400274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.449149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:54.450335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:54.457582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.458036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.458810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.459254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.668608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:54.685887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ec98a21b-11a1-496e-9ab8-6961e96c2633 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.316256 May 27 15:14:54.689252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 153/296] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:54 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:54.721865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:54.722412 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:54.723328 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:54.732979 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.733932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-938c3298-eb23-4b9c-9569-4388b6c72234 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.290901 May 27 15:14:54.734502 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 144/297] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:54 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:54.746084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.747728 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.749754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.976119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:54.989035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b2924744-99f3-47aa-91f5-d7b251cdf845 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1369 microversion: 2.1 time: 0.273433 May 27 15:14:54.990267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 154/298] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:54 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:55.331889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-df8b7c08-7ec0-4ced-ad31-ba7edfae4006 req-15981892-4cba-421b-9142-03d39aae4f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6ebf9a-c645-4e5f-a78c-99539adcdf08", "tag": "44f4f49a-5397-4f3e-9a8f-8b22ac911f1a"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:55.348721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-df8b7c08-7ec0-4ced-ad31-ba7edfae4006 req-15981892-4cba-421b-9142-03d39aae4f2b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.349669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-df8b7c08-7ec0-4ced-ad31-ba7edfae4006 req-15981892-4cba-421b-9142-03d39aae4f2b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.364863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-df8b7c08-7ec0-4ced-ad31-ba7edfae4006 req-15981892-4cba-421b-9142-03d39aae4f2b service nova] Creating event network-changed:44f4f49a-5397-4f3e-9a8f-8b22ac911f1a for instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 on hv-cinder-84254 May 27 15:14:55.373309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-df8b7c08-7ec0-4ced-ad31-ba7edfae4006 req-15981892-4cba-421b-9142-03d39aae4f2b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044832 May 27 15:14:55.374514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 145/299] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:55.703264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:55.704073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:55.711151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.711811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.712802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.713399 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.752895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:55.754260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:55.761742 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.762511 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.763515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.764154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.131673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.144255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1ad9c22e-731e-41de-8a8b-b0e0d5ed9f55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.396045 May 27 15:14:56.150344 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 146/300] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:55 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:56.158141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:56.159807 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:56.170118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.173740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.174806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.190857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.199025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.214799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bab26497-f0f0-4d30-a3e4-2aed2d5b74fa tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.508074 May 27 15:14:56.217172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 155/301] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:55 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:56.230441 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-886c8504-6794-4c69-a367-f8bc588f3a2a req-1e6dcd3f-d31a-4170-b2d1-f2937531b103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2", "name": "network-vif-plugged", "status": "completed", "tag": "c3f1f72a-3e54-4ff0-a70e-71e9e3954a04"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:56.261285 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-886c8504-6794-4c69-a367-f8bc588f3a2a req-1e6dcd3f-d31a-4170-b2d1-f2937531b103 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.273422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-886c8504-6794-4c69-a367-f8bc588f3a2a req-1e6dcd3f-d31a-4170-b2d1-f2937531b103 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.308879 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-886c8504-6794-4c69-a367-f8bc588f3a2a req-1e6dcd3f-d31a-4170-b2d1-f2937531b103 service nova] Creating event network-vif-plugged:c3f1f72a-3e54-4ff0-a70e-71e9e3954a04 for instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 on hv-cinder-84254 May 27 15:14:56.326798 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-886c8504-6794-4c69-a367-f8bc588f3a2a req-1e6dcd3f-d31a-4170-b2d1-f2937531b103 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099758 May 27 15:14:56.328887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 156/302] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:56.744984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.755879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3842e644-b164-4040-9f1c-422d0af9395a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1563 microversion: 2.1 time: 0.604128 May 27 15:14:56.756560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 147/303] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:56 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1563 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:56.775808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:56.776613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:56.789636 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.791473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.792396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.794003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.958031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-598d2caa-8b6e-4ab3-aa16-b38e7ad5fa1d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189127 May 27 15:14:56.959198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 157/304] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:14:56 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:57.168573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:57.169197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:57.176039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.176512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.177299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.177938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.238690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:57.239901 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:57.248025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:57.282618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.282999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.289095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.290658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:58.066240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:58.077300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-655419d6-dadb-4b95-abea-b85b4d7b45a3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.912538 May 27 15:14:58.078203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 148/305] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:57 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:58.086890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:58.101577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-146847c2-f0d0-4c4c-84b6-85bd93f73013 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1315 microversion: 2.1 time: 0.870491 May 27 15:14:58.102736 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 158/306] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:57 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:59.097065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.098215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.111887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.119307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.121411 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.126331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.135221 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.135982 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.140084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.144715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.146647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.151539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.731790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:59.764871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-16a0fb63-85cb-497f-b470-d87d2c1c8896 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1465 microversion: 2.1 time: 0.645994 May 27 15:14:59.777727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 159/307] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:59 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1465 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:59.829982 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.831230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.839999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.840985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.842595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.843134 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.979403 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:00.010822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:00.029640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-23a4a991-fa2e-4a0f-bce1-a4a01fccc1c8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.938338 May 27 15:15:00.030228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 149/308] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:14:59 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:00.202873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2bb3a917-bd4f-471a-bb01-041aff3f4d23 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 204 len: 0 microversion: 2.1 time: 0.383671 May 27 15:15:00.204323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 160/309] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:14:59 2022] DELETE /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:15:00.212977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:00.213487 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:00.224099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.224594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.225390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.226443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.514522 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:00.524544 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-78407950-b669-4992-a871-2882a763d392 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1471 microversion: 2.1 time: 0.315840 May 27 15:15:00.526678 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 150/310] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:00 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:00.656616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-d4c876b8-30de-49ae-af14-d18d366d13a1 req-6a21e5c6-2e33-4d40-9d23-fe99ebd8620c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:00.673329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d4c876b8-30de-49ae-af14-d18d366d13a1 req-6a21e5c6-2e33-4d40-9d23-fe99ebd8620c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.674257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-d4c876b8-30de-49ae-af14-d18d366d13a1 req-6a21e5c6-2e33-4d40-9d23-fe99ebd8620c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.691168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-d4c876b8-30de-49ae-af14-d18d366d13a1 req-6a21e5c6-2e33-4d40-9d23-fe99ebd8620c service nova] Creating event network-changed:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:15:00.702737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-d4c876b8-30de-49ae-af14-d18d366d13a1 req-6a21e5c6-2e33-4d40-9d23-fe99ebd8620c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052531 May 27 15:15:00.704727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 161/311] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:01.047405 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:01.048015 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:01.059817 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:01.061489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.062158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.063102 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.063687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.358490 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:01.369849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-30eeb60b-f616-45d7-a08d-4de7d251df50 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.325839 May 27 15:15:01.383162 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 151/312] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:01 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:01.544720 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:01.546005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:01.558657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.559442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.560375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.561029 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.838672 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:01.851385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-95a9cad1-04c8-4e4c-8e19-78c77f89b34f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1471 microversion: 2.1 time: 0.311923 May 27 15:15:01.852754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 162/313] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:01 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:02.393728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:02.394917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:02.405735 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:02.409285 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.410270 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:02.412256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.606861 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:02.620047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-959f505d-8f2b-4dea-90b1-b3607fe4b8d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.230954 May 27 15:15:02.620676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 152/314] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:02 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:02.874088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:02.874708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:02.887429 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:02.888104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.889068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:02.889663 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.247977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:03.268132 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-5b413825-f68c-4486-98ac-2c4aad056f9f req-11bf550d-320d-43bf-a57d-0f32c5c29a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2", "name": "network-vif-deleted", "tag": "c3f1f72a-3e54-4ff0-a70e-71e9e3954a04"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:03.278393 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8178ecf0-714e-464e-aab1-6c656d633c39 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1471 microversion: 2.1 time: 0.408787 May 27 15:15:03.280743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-5b413825-f68c-4486-98ac-2c4aad056f9f req-11bf550d-320d-43bf-a57d-0f32c5c29a8a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.282107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 163/315] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:02 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:03.283878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-5b413825-f68c-4486-98ac-2c4aad056f9f req-11bf550d-320d-43bf-a57d-0f32c5c29a8a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.315040 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-5b413825-f68c-4486-98ac-2c4aad056f9f req-11bf550d-320d-43bf-a57d-0f32c5c29a8a service nova] Creating event network-vif-deleted:c3f1f72a-3e54-4ff0-a70e-71e9e3954a04 for instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 on hv-cinder-84254 May 27 15:15:03.336434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-5b413825-f68c-4486-98ac-2c4aad056f9f req-11bf550d-320d-43bf-a57d-0f32c5c29a8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072648 May 27 15:15:03.342759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 153/316] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:03.638689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:03.639595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:03.648102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.648832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.650295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.650887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.862152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:03.871519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ddb76513-d962-4642-9abf-2d963e864ec6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.237242 May 27 15:15:03.872150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 164/317] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:03 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:04.299314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.299987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:04.308700 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.309441 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.310419 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.310858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.399598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:04.407877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-da9e12af-6014-4a58-af3e-b4f801b58102 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1429 microversion: 2.1 time: 0.112747 May 27 15:15:04.408547 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 154/318] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:04.890448 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.891225 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:04.901089 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.901511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.902295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.902734 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.929945 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:05.067775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.084327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf234ff9-4394-450d-a91e-6c16e3c4c6bd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.198672 May 27 15:15:05.085160 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 165/319] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:05.426418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:05.429624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:05.438491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.439587 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.440654 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.441827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.487124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.487708 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.488265 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lazy-loading 'fault' on Instance uuid 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:05.545575 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6fbb553cee41319831ee8ef63b932e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14f7f84a9fa48f0985d0a66332b8f1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.558663 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-20f92375-22c5-40c7-af77-a44362358c90 tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 200 len: 1305 microversion: 2.1 time: 0.137144 May 27 15:15:05.559245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 155/320] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:05 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:06.103274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.103944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.120054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.122843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.123843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.125384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.291001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:06.299687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e9ce0f0-7cd1-4797-a91d-d1ff6000faf0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.201169 May 27 15:15:06.300375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 166/321] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:06.575788 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.576699 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] [instance: 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.586341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.586914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.587931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.588488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.603246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] HTTP exception thrown: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Request method failure captured: May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 HTTP/1.1 May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOrcbvAJeA7PBsPxx5sQd2sNMLFZqe2kHN6XyxP3VfjrV1QkA3v7wT_OzuBvyUcCuK7JHX5n1EAFC8Y1RR7vSxzhMhVPNV9y0Az7C3KQ5NGEktl9jg0QUDoztu-pC_HHpaw9hLoN_S46mXjwUcxmcxGI2wrGb0ZsRaWBMNw80Vz_mGc May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: b14f7f84a9fa48f0985d0a66332b8f1d May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesNegativeTest-1027325019 May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:15:06.605449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b14f7f84a9fa48f0985d0a66332b8f1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b14f7f84a9fa48f0985d0a66332b8f1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b14f7f84a9fa48f0985d0a66332b8f1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b14f7f84a9fa48f0985d0a66332b8f1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesNegativeTest-1027325019 May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: b14f7f84a9fa48f0985d0a66332b8f1d May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesNegativeTest-1027325019 May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesNegativeTest-1027325019-project May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: be6fbb553cee41319831ee8ef63b932e May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesNegativeTest-1027325019-project May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. May 27 15:15:06.606986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2'} May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:06.607910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. May 27 15:15:06.609391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:06.611440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] Returning 404 to user: Instance 2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:06.612482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8de95eb5-764d-43ff-8ac4-a9f151ab088f tempest-VolumesNegativeTest-1027325019 tempest-VolumesNegativeTest-1027325019-project] 10.222.0.41 "GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2" status: 404 len: 111 microversion: 2.1 time: 0.040689 May 27 15:15:06.630910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 156/322] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/2e1fd350-618f-4b6f-bdd1-e6c17dacd5a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:07.318185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:07.318803 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:07.327032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.330271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.332690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.333300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.509903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:07.519276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-71a3fc01-612a-4482-8a7d-b6fbe30ed0a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.205384 May 27 15:15:07.520382 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 167/323] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:07 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:08.541999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.543729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.560602 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.561351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.562347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.562939 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.612631 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=100 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:08.880334 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.896783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0f2b4091-bf95-4e6d-9d3f-fdf7bd0eccfc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.362190 May 27 15:15:08.899261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 157/324] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.917216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.918417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.925508 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.926468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.927557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.928351 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.128215 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.139619 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-50d65aa8-3006-4f5e-8bdf-ab431c1e8a88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.227859 May 27 15:15:10.140685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 168/325] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:11.158043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:11.159394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.170771 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.171303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.174962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.175674 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.438559 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.450738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1ee7f12d-263b-4dc5-8572-d26b1b748845 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1721 microversion: 2.1 time: 0.296552 May 27 15:15:11.451456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 158/326] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:12.484692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.485933 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:12.519413 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.525537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.526545 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.527148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.242655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.255786 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a8131d4-f0dd-4939-8b2a-68aac21e58a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1698 microversion: 2.1 time: 0.785877 May 27 15:15:13.257320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 169/327] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1698 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:13.276287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4804a9bb-58a7-4272-9fc0-e5d3159124d4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:13.287855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4804a9bb-58a7-4272-9fc0-e5d3159124d4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.290159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4804a9bb-58a7-4272-9fc0-e5d3159124d4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.322769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4804a9bb-58a7-4272-9fc0-e5d3159124d4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Going to try to start instance {{(pid=117641) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:15:13.394182 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4804a9bb-58a7-4272-9fc0-e5d3159124d4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action" status: 202 len: 0 microversion: 2.1 time: 0.121921 May 27 15:15:13.395369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 159/328] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:15:13 2022] POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:13.405568 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.406316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.417535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.417993 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.421389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.422164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.905407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.922755 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2d245885-05b2-4f53-89b4-a6fc3c2d2635 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1707 microversion: 2.1 time: 0.521873 May 27 15:15:13.924709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 170/329] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1707 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.948212 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.950048 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.958547 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.959011 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.960097 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.960822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.258386 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.271199 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9da896c4-760a-4053-8a28-e79149eec096 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1707 microversion: 2.1 time: 0.332295 May 27 15:15:15.283640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 160/330] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1707 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:16.038954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-37049946-ff34-4e1e-84f9-ddbd2d6bcdd6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'create', calling method: .version_select at 0x7fa372089c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-654495932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI327tuBU3VrxzhyMCSJ6ry6K1U6LTAxhC56tvjC0+xMCSbj/XMnInOdb0klYXyOQEF+vHths8uFjMxqO6OIBkUbrPxj3pEjhfzdn3p5FeKgkOmHpLDnIm8XktKI3z4JbQ=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:16.054282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-37049946-ff34-4e1e-84f9-ddbd2d6bcdd6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Getting quotas for project b9fd239910a6492a953310873fd2379e. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:16.059718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-37049946-ff34-4e1e-84f9-ddbd2d6bcdd6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Getting quotas for user 943b21e6079646dc9f47dd5698278b34 and project b9fd239910a6492a953310873fd2379e. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:16.084043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-37049946-ff34-4e1e-84f9-ddbd2d6bcdd6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049335 May 27 15:15:16.085456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 171/331] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:15:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:16.214024 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1471960450", "imageRef": "3fcfb374-aae6-4597-9c00-92a1d1a4ed89", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-654495932", "networks": [{"uuid": "170b7456-5a19-42c5-bafb-44e2c304f6c0"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:16.288784 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] validate_networks() for [('170b7456-5a19-42c5-bafb-44e2c304f6c0', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:16.291493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:16.292371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:16.299718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.301074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.301982 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.302505 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.560854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:16.571906 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7382fadc-8f38-4c92-a758-4eb62775407a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1711 microversion: 2.1 time: 0.284172 May 27 15:15:16.573528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 172/332] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:16 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1711 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:16.863427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:16.867617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:16.868860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:16.869446 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:16.870092 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:16.882316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.882989 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.883969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.884611 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.917279 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Getting quotas for project b9fd239910a6492a953310873fd2379e. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:16.924947 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Getting quotas for user 943b21e6079646dc9f47dd5698278b34 and project b9fd239910a6492a953310873fd2379e. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:16.942688 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:16.946527 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fcfb374-aae6-4597-9c00-92a1d1a4ed89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:17.022508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cedb4c03-bdce-4b58-b39f-3b8c88b6e1b6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813125 May 27 15:15:17.023832 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 161/333] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:15:17.033719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5330452b-da55-45be-a1ad-e644d171f782 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:17.034578 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5330452b-da55-45be-a1ad-e644d171f782 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:17.106810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5330452b-da55-45be-a1ad-e644d171f782 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.115375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5330452b-da55-45be-a1ad-e644d171f782 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1258 microversion: 2.1 time: 0.085631 May 27 15:15:17.125209 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 173/334] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:17 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:18.133928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:18.134564 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:18.141181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.141868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.142818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.143448 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.277557 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:18.293381 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a859bae7-2310-4dd6-ad31-07661bc04017 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1310 microversion: 2.1 time: 0.163111 May 27 15:15:18.294506 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 162/335] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:18 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:19.311137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:19.315860 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:19.337116 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:19.337850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:19.338792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:19.339398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.017880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:20.034885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3743af1-c2b4-4448-894a-cb67e302b904 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.727449 May 27 15:15:20.036162 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 174/336] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:19 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:21.052432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:21.053880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:21.065301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.065952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.067549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.070759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.458118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:21.483672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1c9277f9-d656-447f-85aa-26ab6bbe58c1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.435082 May 27 15:15:21.485152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 163/337] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:21 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:22.078780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-5fd6975d-0f1b-4c36-812f-56fed92beca6 req-bc9919d5-09c8-4a76-a61b-2874f03d112e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:22.098527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5fd6975d-0f1b-4c36-812f-56fed92beca6 req-bc9919d5-09c8-4a76-a61b-2874f03d112e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.100544 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-5fd6975d-0f1b-4c36-812f-56fed92beca6 req-bc9919d5-09c8-4a76-a61b-2874f03d112e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.134046 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-5fd6975d-0f1b-4c36-812f-56fed92beca6 req-bc9919d5-09c8-4a76-a61b-2874f03d112e service nova] Creating event network-changed:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:15:22.146691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-5fd6975d-0f1b-4c36-812f-56fed92beca6 req-bc9919d5-09c8-4a76-a61b-2874f03d112e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071835 May 27 15:15:22.148614 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 175/338] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:22.501412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:22.502035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:22.512831 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.514216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.515214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.516531 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.014925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:23.028787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ba1deaf9-4656-4fee-afb7-8ec24e12e9dd tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.531127 May 27 15:15:23.031513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 164/339] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:22 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:24.046998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:24.055736 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:24.074642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.075293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.076375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.086473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.392757 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.405409 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1cb2da51-3a76-46ff-ac9a-a53594e645c8 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.362681 May 27 15:15:24.406711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 176/340] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:24 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:25.449150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:25.454894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:25.486983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.487635 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.488627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.489316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.901585 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.916068 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-055722c4-3847-4b3f-b48f-287c837b3c07 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.494899 May 27 15:15:25.921706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 165/341] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:25 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:26.933522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:26.934141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:26.948436 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.949196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.950147 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.950740 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.113625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:27.290301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:27.291627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:27.306325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:27.317021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cab536f6-6150-4873-9212-f4218cc91bb1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.387209 May 27 15:15:27.320067 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 177/342] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:26 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:27.685258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-194d137a-893e-4e0a-8306-705769145f28 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Action: 'create', calling method: .version_select at 0x7fa372793310>, body: {"keypair": {"name": "tempest-TestShelveInstance-464767388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiqpJmk36D5+bp3dT+GD2sPc9kRPLeR0HQnPNPKy8V16U8hlPFX4Q883v5eXm5H5pi+8EKNPkAe4yh2mocHnwe11w6fRJ2LAEGkjGeyJqtuEAV4iuIShuKis+pChz13Gg=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:27.708125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-194d137a-893e-4e0a-8306-705769145f28 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Getting quotas for project 32fb068c248a4cb9bb0e73dab923ca19. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:27.714103 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-194d137a-893e-4e0a-8306-705769145f28 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Getting quotas for user 3b7eb6c795964aaa92e7f1fd3993a29c and project 32fb068c248a4cb9bb0e73dab923ca19. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:27.752137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-194d137a-893e-4e0a-8306-705769145f28 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.467819 May 27 15:15:27.757700 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 166/343] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:15:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:28.337235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:28.337936 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:28.341753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:28.348469 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:28.348975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.349759 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:28.350871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.508819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:28.516820 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9692552-854e-4337-88a4-fa2e76b2a710 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.185380 May 27 15:15:28.517421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 178/344] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:28 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:29.540679 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:29.541705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:29.550109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.550644 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.551664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.552427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.708631 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:29.717827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-954c6b72-fd9a-46db-8586-bbf89e9bd530 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.184303 May 27 15:15:29.719014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 167/345] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:29 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:30.743965 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:30.744607 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:30.766742 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:30.767235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:30.768017 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:30.768489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:30.914106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:30.922154 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7bae6117-38a3-4e1e-8176-4a023234711d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.186241 May 27 15:15:30.922878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 179/346] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:30 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:31.940257 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:31.940909 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:31.943354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:31.951006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.951453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.952230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.952692 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:32.097300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:32.105428 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9e14944e-9fab-4390-9037-1c5fe62071b1 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.169189 May 27 15:15:32.105986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 168/347] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:31 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:33.122514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:33.123129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:33.129959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:33.130455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:33.131354 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:33.131843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:33.268745 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:33.276795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83715be0-0b87-466b-aded-244497730d6d tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.158135 May 27 15:15:33.277357 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 180/348] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:33 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:33.387319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-bd7c68ff-cc4e-473a-9d31-a51cc12aef0b req-64064785-f952-4ecc-95cd-c3e1423a3b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "name": "network-vif-plugged", "status": "completed", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:33.397501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bd7c68ff-cc4e-473a-9d31-a51cc12aef0b req-64064785-f952-4ecc-95cd-c3e1423a3b61 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:33.397963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bd7c68ff-cc4e-473a-9d31-a51cc12aef0b req-64064785-f952-4ecc-95cd-c3e1423a3b61 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:33.409070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-bd7c68ff-cc4e-473a-9d31-a51cc12aef0b req-64064785-f952-4ecc-95cd-c3e1423a3b61 service nova] Creating event network-vif-plugged:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:15:33.414783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-bd7c68ff-cc4e-473a-9d31-a51cc12aef0b req-64064785-f952-4ecc-95cd-c3e1423a3b61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 May 27 15:15:33.415367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 169/349] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:34.300828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:34.302166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:34.314085 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:34.314591 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:34.315422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:34.315905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:34.448013 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:34.455345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a6b94415-cd0c-4631-8682-5ea26c18cbcc tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.163333 May 27 15:15:34.455896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 181/350] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:34 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:35.474367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:35.475763 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:35.482516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.483214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.484133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.484622 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.620285 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:35.629721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c835cf86-7307-48fa-bd2d-a8916eca5fe9 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1358 microversion: 2.1 time: 0.160014 May 27 15:15:35.630437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 170/351] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:35 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:36.648712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.649327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:36.655816 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.656267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.657060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.657501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.661675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=84 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:36.791346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.798864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd2ad1e7-c064-401b-bd7d-714803854dc7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1547 microversion: 2.1 time: 0.154768 May 27 15:15:36.799421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 182/352] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:36 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:36.815158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.815749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:36.822717 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.823505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.824263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.824726 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.954543 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.962749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-30aa8807-87f5-49e0-8828-747f6213ca22 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1547 microversion: 2.1 time: 0.151380 May 27 15:15:36.963322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 171/353] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:36 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:36.978567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.982064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.982824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Searching by: {'deleted': False, 'project_id': 'b9fd239910a6492a953310873fd2379e'} {{(pid=117642) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:36.989783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.990262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.991061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.991503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.083286 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.multi_cell_list [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:37.181624 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c7521a37-2e04-44f4-969b-2ddd713f5c20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206832 May 27 15:15:37.182116 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 183/354] 10.222.0.41 () {58 vars in 1124 bytes} [Fri May 27 15:15:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:37.192233 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:37.192803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:37.199931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.200387 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.201175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.201609 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.338720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:37.346330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1ea45541-aa70-470b-a2ef-c2d80158fff5 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1547 microversion: 2.1 time: 0.158012 May 27 15:15:37.346885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 172/355] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:37 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:38.859610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b241992-b0be-4a08-ac76-aea930148145"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:38.860740 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:38.867906 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.868356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:38.869148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.869591 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:39.129567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b2b35221-e68b-445f-85ee-0e497aca87ce tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273822 May 27 15:15:39.130241 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 184/356] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:15:38 2022] POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:41.058614 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.059191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.061261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:41.066718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.067167 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.067923 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.069324 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.072216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:41.095037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-dd9bd1fa-e0b2-48d7-8620-1fac87d3cfcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/ips" status: 200 len: 149 microversion: 2.1 time: 0.040276 May 27 15:15:41.095727 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 173/357] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:15:41 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:41.107065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c5c1d2-b544-476b-b85f-87068da26a62"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:41.108206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.114481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.114942 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.116349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.116818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.206604 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/os-volume_attachments HTTP/1.1 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 74 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:15:41.207366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {"volumeAttachment": {"volumeId": "d6c5c1d2-b544-476b-b85f-87068da26a62"}} May 27 15:15:41.208664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'server_id': 'fc6ebf9a-c645-4e5f-a78c-99539adcdf08', 'body': {'volumeAttachment': {'volumeId': 'd6c5c1d2-b544-476b-b85f-87068da26a62'}}} May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:41.209769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:41.211743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 400 to user: Invalid volume: volume d6c5c1d2-b544-476b-b85f-87068da26a62 is already attached to instances: d5d00cd5-e391-4c55-a071-152ec1cf4c04 {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8a483a85-e8c5-40e8-b9a1-0ed8a4d9cdb6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106257 May 27 15:15:41.213602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 185/358] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:15:41 2022] POST /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:15:41.218829 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.219351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.225937 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.226390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.227149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.227591 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.252664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:41.329363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9b2fd620-490b-48a7-a5d7-d04ada931d93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 204 len: 0 microversion: 2.1 time: 0.115149 May 27 15:15:41.330191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 174/359] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:15:41 2022] DELETE /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:15:41.339251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.339852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.347003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.347445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.348191 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.348656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.481081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:41.488368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06fae230-b910-48cb-b63c-c1bbe45e891a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1681 microversion: 2.1 time: 0.153163 May 27 15:15:41.488949 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 186/360] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:41 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:42.506440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:42.507142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:42.513610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.514062 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.514834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.515276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.646946 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.654453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-32998cf4-a7ff-4355-af71-329050a6bc58 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1681 microversion: 2.1 time: 0.152489 May 27 15:15:42.655013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 175/361] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:42 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:43.054828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "936809db-4c9d-4d7d-886e-a6628e64492c"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:43.055946 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:43.062422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.062875 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.063644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.064080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.328334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-759a7529-54a1-4dd1-aca8-92ab6a052f12 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277966 May 27 15:15:43.328980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 187/362] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:15:43 2022] POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:43.671843 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:43.673175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:43.679683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.680132 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.680981 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.681420 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.764148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:43.772232 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c08ac753-026d-4903-bb53-2aa2f6d68fa5 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 200 len: 1613 microversion: 2.1 time: 0.103612 May 27 15:15:43.773242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 176/363] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:43 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:43.937884 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2f598ec8-2539-4370-98ed-f3a229f3835f req-e0bd05bb-6ee2-4377-859d-984041b7775d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6ebf9a-c645-4e5f-a78c-99539adcdf08", "name": "network-vif-deleted", "tag": "44f4f49a-5397-4f3e-9a8f-8b22ac911f1a"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:43.947834 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2f598ec8-2539-4370-98ed-f3a229f3835f req-e0bd05bb-6ee2-4377-859d-984041b7775d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.948546 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2f598ec8-2539-4370-98ed-f3a229f3835f req-e0bd05bb-6ee2-4377-859d-984041b7775d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.961049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2f598ec8-2539-4370-98ed-f3a229f3835f req-e0bd05bb-6ee2-4377-859d-984041b7775d service nova] Creating event network-vif-deleted:44f4f49a-5397-4f3e-9a8f-8b22ac911f1a for instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 on hv-cinder-84254 May 27 15:15:43.967743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2f598ec8-2539-4370-98ed-f3a229f3835f req-e0bd05bb-6ee2-4377-859d-984041b7775d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035596 May 27 15:15:43.968374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 188/364] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:44.791117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:44.791940 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:44.806836 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.807377 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.808320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.808801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.824933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 HTTP/1.1 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:15:44.826608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:15:44.828079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'fc6ebf9a-c645-4e5f-a78c-99539adcdf08'} May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:44.828975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:15:44.830413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:15:44.831705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:44.831705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cf5d2b26-384a-40c7-a130-93a18c454ae3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 404 len: 111 microversion: 2.1 time: 0.040886 May 27 15:15:44.831952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 177/365] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:44 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:44.838248 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-33c82286-2303-46c9-8d94-bba83d791504 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '.version_select at 0x7fa3720b0ee0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:44.859040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-33c82286-2303-46c9-8d94-bba83d791504 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619848697" status: 202 len: 0 microversion: 2.1 time: 0.025414 May 27 15:15:44.859604 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 189/366] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 15:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619848697 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:45.606123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:45.606641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:45.612917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.613421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.614217 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.614685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.774345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lazy-loading 'services' on Instance uuid d5d00cd5-e391-4c55-a071-152ec1cf4c04 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:45.912627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4f170617-4fe1-4a24-9a50-eef282db4320 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments/d6c5c1d2-b544-476b-b85f-87068da26a62" status: 202 len: 0 microversion: 2.1 time: 0.309874 May 27 15:15:45.913807 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 178/367] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:15:45 2022] DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments/d6c5c1d2-b544-476b-b85f-87068da26a62 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:45.929202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:45.930437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:45.937584 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.938040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.939141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.939260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.970244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8158e5bf-ec61-448e-91d8-28a595459165 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052308 May 27 15:15:45.970791 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 190/368] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:45 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:46.502538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2057362316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-464767388", "security_groups": [{"name": "tempest-secgroup-smoke-520452649"}], "networks": [{"uuid": "cd8a9dc1-c16d-4f7d-8be2-f21b49a26a3a"}], "block_device_mapping_v2": [{"uuid": "5ca4528b-f3e3-467b-8a4c-08eee1b09bcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:46.637392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] validate_networks() for [('cd8a9dc1-c16d-4f7d-8be2-f21b49a26a3a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:46.769291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.769898 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:46.777168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.777620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.778380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.779001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.982832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:46.991478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3265da77-c3dd-4183-929a-b1d0ceb9624c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1593 microversion: 2.1 time: 0.225879 May 27 15:15:46.992282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 191/369] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1593 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:46.997051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.997965 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:47.003780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.004481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.005247 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.006372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.026279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:47.037913 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5c390d1e-c34f-4323-ac7e-5a4879e5a954 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 May 27 15:15:47.038478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 192/370] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:47.112201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:47.112704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:47.113145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:47.113811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:47.114520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:47.123926 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.124331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.125187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.125628 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.142759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Getting quotas for project 32fb068c248a4cb9bb0e73dab923ca19. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:47.147362 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Getting quotas for user 3b7eb6c795964aaa92e7f1fd3993a29c and project 32fb068c248a4cb9bb0e73dab923ca19. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:47.206686 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:47.209626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ca4528b-f3e3-467b-8a4c-08eee1b09bcb',volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:47.354052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1f30e342-35be-47e6-bab6-2563e9e71875 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855987 May 27 15:15:47.355389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 179/371] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:15:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:15:47.365864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21d4d4be-69eb-4afe-8894-89af33966664 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:47.367096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21d4d4be-69eb-4afe-8894-89af33966664 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:47.432718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-21d4d4be-69eb-4afe-8894-89af33966664 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:47.440822 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21d4d4be-69eb-4afe-8894-89af33966664 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1088 microversion: 2.1 time: 0.079579 May 27 15:15:47.441700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 193/372] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:47 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:48.050023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:48.051318 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:48.058701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.059159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.059935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.060440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.090342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a6c27d78-589a-4fbe-bb2e-11fda85cdfee tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 May 27 15:15:48.090907 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 180/373] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:48 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:48.458199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:48.460314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:48.468144 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.468843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.469650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.470096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.549494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:48.557793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f880e346-6489-402e-8424-e88320850d80 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1204 microversion: 2.1 time: 0.103406 May 27 15:15:48.558501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 194/374] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:48 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:48.911336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-f6a79e54-e8c8-4bec-8c0f-e0a5dd3f36a4 req-b4aa8fe4-8740-4afe-bc4f-f1e4eb9f57ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:48.919805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f6a79e54-e8c8-4bec-8c0f-e0a5dd3f36a4 req-b4aa8fe4-8740-4afe-bc4f-f1e4eb9f57ff service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.920246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f6a79e54-e8c8-4bec-8c0f-e0a5dd3f36a4 req-b4aa8fe4-8740-4afe-bc4f-f1e4eb9f57ff service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.931649 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-f6a79e54-e8c8-4bec-8c0f-e0a5dd3f36a4 req-b4aa8fe4-8740-4afe-bc4f-f1e4eb9f57ff service nova] Creating event network-changed:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:15:48.936911 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-f6a79e54-e8c8-4bec-8c0f-e0a5dd3f36a4 req-b4aa8fe4-8740-4afe-bc4f-f1e4eb9f57ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028986 May 27 15:15:48.937701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 181/375] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:49.102779 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:49.103715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:49.110661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.111455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.112738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.113441 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.148302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5348350a-0022-4da0-9156-87bee56a41ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049936 May 27 15:15:49.149236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 195/376] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:49 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:49.576461 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:49.577347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:49.595277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.596024 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.597555 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.598393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.711966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.722610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6396283e-3952-4909-921f-930536acf45e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1204 microversion: 2.1 time: 0.151085 May 27 15:15:49.726285 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 182/377] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:49 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1204 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:50.159499 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:50.160647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.168345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.168912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.169765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.170295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.215886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bb4fb854-5791-4ceb-85d6-ba94c90be7c3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060359 May 27 15:15:50.217051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 196/378] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:50 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:50.278969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1341750672"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:50.279519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.286149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.286599 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.287416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.287863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.498920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.network.security_group_api [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Adding security group d8d76f4a-c578-47cc-afad-e8384745f9c3 to port 07ab533a-c377-484b-8298-8e84d7500fd8 May 27 15:15:50.742465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:50.743107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.749504 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.749880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.750644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.751078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.080914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:51.089114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6f141f79-d555-4ec3-b5a6-9c8d9623d026 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1271 microversion: 2.1 time: 0.351211 May 27 15:15:51.089677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 197/379] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:50 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:51.228040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.230284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.231934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bbbb66ac-7dad-4511-99d3-b8f402cedb67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action" status: 202 len: 0 microversion: 2.1 time: 0.956984 May 27 15:15:51.236412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 183/380] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:15:50 2022] POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:51.239485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.240138 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.241375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.242245 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.242892 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.244288 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.260918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.269783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:51.273027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.274058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.274515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.307449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-18d8dd65-9526-46d4-9ec9-2ece9da2d0b6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083144 May 27 15:15:51.308686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 198/381] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:51.314585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2c38f8ce-070b-4595-b5a6-cd0dc01c3ce6 req-81d81656-c0bf-4abd-9fa4-65af1b1d38ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:51.326671 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2c38f8ce-070b-4595-b5a6-cd0dc01c3ce6 req-81d81656-c0bf-4abd-9fa4-65af1b1d38ee service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.327334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2c38f8ce-070b-4595-b5a6-cd0dc01c3ce6 req-81d81656-c0bf-4abd-9fa4-65af1b1d38ee service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.342570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-2c38f8ce-070b-4595-b5a6-cd0dc01c3ce6 req-81d81656-c0bf-4abd-9fa4-65af1b1d38ee service nova] Creating event network-changed:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:15:51.349466 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2c38f8ce-070b-4595-b5a6-cd0dc01c3ce6 req-81d81656-c0bf-4abd-9fa4-65af1b1d38ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 May 27 15:15:51.350955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 199/382] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:51.615288 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:51.623521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-db445c1b-3706-416e-a8ed-23fb3467e8f7 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1758 microversion: 2.1 time: 0.385209 May 27 15:15:51.624534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 184/383] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1758 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:52.107068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:52.107679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:52.113734 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.114178 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.114937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.115365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.315528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.321877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:52.322899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:52.326133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6dfaa2b3-6d60-4630-8ae5-4d9550aaaa64 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1271 microversion: 2.1 time: 0.223467 May 27 15:15:52.327212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 200/384] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:52 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:52.335195 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.335869 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.336856 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.337297 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.369304 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-192f6074-93fa-49af-afd1-d02f5ac03c5c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053208 May 27 15:15:52.369780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 185/385] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:52 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:53.058330 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:53.060142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.069985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.073009 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.074940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.077620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.106726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lazy-loading 'flavor' on Instance uuid dc3e5216-919a-4963-93ed-d2785f1d8a48 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:53.244628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-09a8f512-ce9a-43d3-9006-54296f95c7d7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/action" status: 200 len: 32 microversion: 2.1 time: 0.190732 May 27 15:15:53.245309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 201/386] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:15:53 2022] POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:53.255668 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.256311 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.263830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.264274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.265088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.265544 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.344718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.345482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.352575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.353074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.353878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.354348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.689897 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.698725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3ad15efa-0084-4481-a246-fc3610c2be8a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.448024 May 27 15:15:53.699295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 186/387] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:53.704539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.705529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.711963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.712427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.712943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.713230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.713678 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.720829 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-19fd4a6a-e1c9-4088-86b6-6c72955064bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1271 microversion: 2.1 time: 0.381107 May 27 15:15:53.728723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 202/388] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1271 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:53.733357 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-8bb06c44-830e-4479-85dc-00fe5bb2122c req-81a51cf8-4f84-45b1-80f4-53725ee308a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:53.742937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8bb06c44-830e-4479-85dc-00fe5bb2122c req-81a51cf8-4f84-45b1-80f4-53725ee308a9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.743383 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-8bb06c44-830e-4479-85dc-00fe5bb2122c req-81a51cf8-4f84-45b1-80f4-53725ee308a9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.745095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2c4ef355-ef3d-4f45-bb2f-abf57035c4d2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044136 May 27 15:15:53.747070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 187/389] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:53.754625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-8bb06c44-830e-4479-85dc-00fe5bb2122c req-81a51cf8-4f84-45b1-80f4-53725ee308a9 service nova] Creating event network-changed:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:15:53.760638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-8bb06c44-830e-4479-85dc-00fe5bb2122c req-81a51cf8-4f84-45b1-80f4-53725ee308a9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030960 May 27 15:15:53.761299 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 203/390] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:53.804104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.804629 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.810590 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.811042 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.811804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.812250 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.837205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:53.881747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:53.913599 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d2de1996-92e9-4816-9f75-5959fef437a7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 204 len: 0 microversion: 2.1 time: 0.113653 May 27 15:15:53.914170 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 188/391] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:15:53 2022] DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:15:53.922713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.923398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.930907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.931288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.932057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.932497 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.094501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.102776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cf721ff4-d5ed-4b97-93aa-a104bb94a97c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1682 microversion: 2.1 time: 0.184142 May 27 15:15:54.103325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 204/392] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:54.716767 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.717430 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.725084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.725649 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.726469 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.726944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.737701 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.738311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.745027 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.745480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.746263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.746684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.912618 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.921412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-70759100-51ad-420f-84fa-ca7d1eed663e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.208875 May 27 15:15:54.922433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 189/393] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:54.938041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.945656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1695b9ce-63e4-49b7-84f4-7248ab203d97 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.211774 May 27 15:15:54.946207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 205/394] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:55.120155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.120824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.127653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.128234 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.129052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.129501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.265745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.274185 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-beb805c2-2630-4f38-bc82-9895419d4a26 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1682 microversion: 2.1 time: 0.158237 May 27 15:15:55.274737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 190/395] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:55.946579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.948109 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.954588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.955118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.956989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.956989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.962137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.962948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.972524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.974494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.975628 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.976559 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.282261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:56.292276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d9c25a2a-a3ea-43f0-899f-b3142eea85ca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.350204 May 27 15:15:56.295504 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:56.302462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 206/396] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:56.306370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1ccd2ba2-062f-418e-bcc0-5e48542962c0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.348020 May 27 15:15:56.308196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.309128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:56.315527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.316196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.317007 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 191/397] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:56.317381 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.317852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.461393 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:56.469158 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4622b25a-ac87-45f3-a17f-bc0a63989df0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1682 microversion: 2.1 time: 0.165260 May 27 15:15:56.469722 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 207/398] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:57.030918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-e9a731ad-88b7-44c9-92e1-98a8e5bf5faf req-67501c28-e7e8-4934-af56-17923619ebf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d00cd5-e391-4c55-a071-152ec1cf4c04", "name": "network-vif-deleted", "tag": "806f4f1c-0d26-4fec-be62-86145b66b5e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:57.041034 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e9a731ad-88b7-44c9-92e1-98a8e5bf5faf req-67501c28-e7e8-4934-af56-17923619ebf7 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.041570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e9a731ad-88b7-44c9-92e1-98a8e5bf5faf req-67501c28-e7e8-4934-af56-17923619ebf7 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.054479 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-e9a731ad-88b7-44c9-92e1-98a8e5bf5faf req-67501c28-e7e8-4934-af56-17923619ebf7 service nova] Creating event network-vif-deleted:806f4f1c-0d26-4fec-be62-86145b66b5e8 for instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 on hv-cinder-84254 May 27 15:15:57.061062 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-e9a731ad-88b7-44c9-92e1-98a8e5bf5faf req-67501c28-e7e8-4934-af56-17923619ebf7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 May 27 15:15:57.064912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 192/399] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:57.310048 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:57.310538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.317366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.317999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.319129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.319881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.324022 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:57.324720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.326847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:57.327632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:57.335574 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.336067 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.336886 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.337501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.441917 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:57.545133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.545672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.554150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-831f45f9-88e3-4d3a-bb6f-e1a668da6f41 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.234533 May 27 15:15:57.554727 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 193/400] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:57 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:57.559944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:57.561064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.563814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f05cd9ea-2f6d-414f-a199-4afa8f78f280 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.258010 May 27 15:15:57.564395 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 208/401] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:57 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:57.569083 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.569751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.570711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.571157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.609474 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.610191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.610826 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lazy-loading 'fault' on Instance uuid d5d00cd5-e391-4c55-a071-152ec1cf4c04 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:57.667764 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.683553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a44385c4-cd57-4849-805c-23019b7310e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 200 len: 1331 microversion: 2.1 time: 0.127495 May 27 15:15:57.684484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 194/402] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:57 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.572105 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.572743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.575063 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:58.580528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.581018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.581533 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.581971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.582154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.582255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.589393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.589850 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.590626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.591073 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.782624 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.787141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.790894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f8d56d5d-f48f-4da2-96cb-8da8931620dc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.223612 May 27 15:15:58.791457 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 209/403] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.796372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.796581 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0fe3d487-85e5-40ba-887d-1ae7c416ab3c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.218746 May 27 15:15:58.797044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.797437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 195/404] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.803645 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.804098 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.804894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.805329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.818359 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 HTTP/1.1 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:15:58.820148 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:15:58.821802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'd5d00cd5-e391-4c55-a071-152ec1cf4c04'} May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:58.822871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:15:58.824282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:15:58.825691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:58.825691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a83a422e-21e7-4387-8309-4716f0351621 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 404 len: 111 microversion: 2.1 time: 0.029172 May 27 15:15:58.825691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 210/405] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:58.830343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fd2ed284-ff81-4912-8078-a0ae7044336f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '.version_select at 0x7fa372749280>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.848482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fd2ed284-ff81-4912-8078-a0ae7044336f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219859071" status: 202 len: 0 microversion: 2.1 time: 0.021831 May 27 15:15:58.849573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 196/406] 10.222.0.41 () {58 vars in 1220 bytes} [Fri May 27 15:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219859071 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:58.858184 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.858679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.865331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.865790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.866564 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.867016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.006235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lazy-loading 'services' on Instance uuid 90285ea2-a28f-4844-9a8a-652ecafc72ef {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:59.125258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dfe4e109-3624-4557-95a1-9e6788653eaa tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments/e0f6596a-4c63-43f6-98c5-ef26d4edd71d" status: 202 len: 0 microversion: 2.1 time: 0.270800 May 27 15:15:59.125836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 211/407] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:15:58 2022] DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments/e0f6596a-4c63-43f6-98c5-ef26d4edd71d => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:59.536164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0ca1663a-293f-4e30-890f-bbfba083bab1 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: .version_select at 0x7fa3727931f0>, body: {"keypair": {"name": "tempest-keypair-194488962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbG7rYTMEFh/CGVoowPQVmasKNWRPpCl8vbPaJSrR15+xKBdwp46Vo80oA5wxvGiaqN9uwTA7m7hYY6PTM9kLdV8M/mLjAbLxQ8LAis+YwJc3kYJRKE8+mAwWLT4K2kvw=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:59.550580 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-0ca1663a-293f-4e30-890f-bbfba083bab1 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:59.555145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-0ca1663a-293f-4e30-890f-bbfba083bab1 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:59.570144 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:59.578620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0ca1663a-293f-4e30-890f-bbfba083bab1 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046367 May 27 15:15:59.579213 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 197/408] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:15:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:59.809171 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.809967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.815498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.816273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.816805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.817365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.818850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.819363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.825786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.826276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.827593 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.828961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.049877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.058137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.066437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5b04c9ff-e262-4962-b871-d79995df9c2e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.255054 May 27 15:16:00.067014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 198/409] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:00.076595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7398fa8a-8a30-499c-ba3e-e0a46c2cae2f tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.263109 May 27 15:16:00.076595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 212/410] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:00.263285 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bbf0f61d-b3fc-48a3-978f-1310820e075d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:00.269505 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbf0f61d-b3fc-48a3-978f-1310820e075d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.269969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bbf0f61d-b3fc-48a3-978f-1310820e075d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.333522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bbf0f61d-b3fc-48a3-978f-1310820e075d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Going to try to stop instance {{(pid=117642) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:16:00.358095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:00.382062 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bbf0f61d-b3fc-48a3-978f-1310820e075d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action" status: 202 len: 0 microversion: 2.1 time: 0.122722 May 27 15:16:00.382980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 213/411] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:16:00 2022] POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:00.390979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.392263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.398769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.399310 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.400164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.400715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.555794 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.563316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-952fadce-7b06-4116-aa38-0a68c2d463e8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.176433 May 27 15:16:00.563879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 199/412] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:00.976118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1961873644", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25b92ae9-fc97-4437-8dc2-335b8971db2a"}], "security_groups": [{"name": "tempest-securitygroup--2107713845"}], "key_name": "tempest-keypair-194488962", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:01.083255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.084090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.085694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] validate_networks() for [('25b92ae9-fc97-4437-8dc2-335b8971db2a', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:01.091182 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.091966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.092834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.093279 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.287975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.296617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6dd98e78-b3ae-4136-a1aa-fcae7e07f7e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.217320 May 27 15:16:01.297225 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 200/413] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:01.302253 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.302875 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.309716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.310174 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.311277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.311929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.515139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.523246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-27f8d33f-3261-4e06-83fd-7c87898a32fc tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.224872 May 27 15:16:01.523815 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 201/414] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:01.581493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.582107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.588701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.589616 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.590399 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.590852 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.602082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:01.602579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:01.603123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:01.603621 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:01.604095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:01.612833 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.613355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.614226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.614784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.631624 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:01.635743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:01.648126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:01.650567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:01.701033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-191fa54b-5d9b-4f2e-b6c1-16687c6b72d3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730385 May 27 15:16:01.701952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 214/415] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:16:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:01.712113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b636867d-104b-4d88-9257-21ed269733aa tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.713181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b636867d-104b-4d88-9257-21ed269733aa tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.751745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.760051 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f01b35d8-7316-4633-9b6a-75bc3bb10917 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.182371 May 27 15:16:01.760757 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 202/416] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:01.773070 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b636867d-104b-4d88-9257-21ed269733aa tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.779919 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b636867d-104b-4d88-9257-21ed269733aa tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1241 microversion: 2.1 time: 0.072057 May 27 15:16:01.780702 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 215/417] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:02.313697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.314300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.321591 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.322044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.322816 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.323254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.451140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.459408 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-72c13485-6847-486a-bf58-a5ef67355898 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.149286 May 27 15:16:02.459969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 203/418] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.540967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.541569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.548290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.548764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.549519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.549952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.694665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.704247 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ab81afd-0cd1-464b-a64c-d57e7a5d7415 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.167804 May 27 15:16:02.705270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 216/419] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.778956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.779604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.787066 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.788087 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.789131 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.789569 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.796491 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.797104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.804468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.805854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.807073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.807073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.885666 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.893369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2f882810-756f-49b8-8fb7-f19a97042d92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1299 microversion: 2.1 time: 0.100675 May 27 15:16:02.894126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 217/420] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.953043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.961494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-65294a8f-8a72-40ed-b54d-bde750a5fbcd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.187230 May 27 15:16:02.962059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 204/421] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:03.477269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.477823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.484041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.484662 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.485562 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.486169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.652280 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.660946 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-264d560e-37df-4645-a429-c934b3b5e4e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.188119 May 27 15:16:03.671480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 218/422] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:03.725656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.728543 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.738351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.739152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.740762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.742342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.889023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.897734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-062042d5-c69c-4558-b04e-bf4a65e9e51c tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.178747 May 27 15:16:03.898321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 205/423] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:03.911266 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.912033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.918718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.919271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.920056 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.920529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.978340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.979042 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.987496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.988306 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.989393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.990145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.158090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.166656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-44673f7a-3f9a-4261-ad4d-130c6f3b2601 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.259290 May 27 15:16:04.175798 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 219/424] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.226477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.238299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0c4fd4c2-6741-43d5-829f-71cc128e765f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.263965 May 27 15:16:04.242166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-105f6be6-5562-432d-ab6f-a065ff0bab23 req-de59c671-c34e-4164-bf85-573dc42850e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf6cd350-0623-438f-9e66-2e086037c8be", "tag": "e0325de7-c795-44a6-8a5c-f7ee84487683"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:04.261099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-105f6be6-5562-432d-ab6f-a065ff0bab23 req-de59c671-c34e-4164-bf85-573dc42850e6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.261099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-105f6be6-5562-432d-ab6f-a065ff0bab23 req-de59c671-c34e-4164-bf85-573dc42850e6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.261442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 206/425] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.267536 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-105f6be6-5562-432d-ab6f-a065ff0bab23 req-de59c671-c34e-4164-bf85-573dc42850e6 service nova] Creating event network-changed:e0325de7-c795-44a6-8a5c-f7ee84487683 for instance bf6cd350-0623-438f-9e66-2e086037c8be on hv-cinder-84254 May 27 15:16:04.273235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-105f6be6-5562-432d-ab6f-a065ff0bab23 req-de59c671-c34e-4164-bf85-573dc42850e6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059290 May 27 15:16:04.274167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 220/426] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:04.678883 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.679494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.685505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.685954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.686714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.687150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.702848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:04.820169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.828219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-96e24242-e73a-4622-94d4-9217407f09e1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.153786 May 27 15:16:04.828822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 207/427] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.915586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.916264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.922418 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.922871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.923629 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.924068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.054864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.062392 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1c30ce4e-c957-4f4f-8255-a2a9ca14f733 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.151648 May 27 15:16:05.062940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 221/428] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:05.183621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.184166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.190422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.190940 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.191706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.192147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.268719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.269479 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.275764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.276225 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.277025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.277471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.352726 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.360080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-580b2e57-95d2-40b0-8afe-5e95591a5ccf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.180329 May 27 15:16:05.360673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 208/429] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:05.418530 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.425911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ecca59ad-8edd-455d-8254-a5ed0c9f43a4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.161083 May 27 15:16:05.426464 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 222/430] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:05.566720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-62c36c5c-ea22-4d67-872e-84506e33949d req-b7f5ec56-4781-4b05-9d97-51f5d4736bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "name": "network-vif-plugged", "status": "completed", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:05.577007 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-62c36c5c-ea22-4d67-872e-84506e33949d req-b7f5ec56-4781-4b05-9d97-51f5d4736bbf service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.577455 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-62c36c5c-ea22-4d67-872e-84506e33949d req-b7f5ec56-4781-4b05-9d97-51f5d4736bbf service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.590857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-62c36c5c-ea22-4d67-872e-84506e33949d req-b7f5ec56-4781-4b05-9d97-51f5d4736bbf service nova] Creating event network-vif-plugged:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:16:05.596169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-62c36c5c-ea22-4d67-872e-84506e33949d req-b7f5ec56-4781-4b05-9d97-51f5d4736bbf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033431 May 27 15:16:05.596975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 209/431] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:05.846172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.846809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.853327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.853781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.854558 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.855121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.001571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.010940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1e978dc0-00a0-46a3-a4ba-f3b04f05cc85 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.168629 May 27 15:16:06.011512 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 223/432] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.079737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.080431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.087760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.088208 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.089006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.089445 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.219818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.228228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9afbbc88-7f50-4cf4-a6ce-1c41314e454e tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.152692 May 27 15:16:06.228827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 210/433] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.378127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.379444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.386522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.386637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.387421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.387864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.443327 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.443947 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.450343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.450805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.451600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.452058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.563520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.571149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-74f62c5d-4456-42cc-85a2-b181c1b0ad8a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.197254 May 27 15:16:06.571709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 224/434] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.618535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.625920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c23f2ece-6e57-4956-8ac0-28bde7b2e031 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.186611 May 27 15:16:06.626479 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 211/435] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:07.027842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.028457 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.034954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.035408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.036165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.036739 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.167196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.175139 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bc72ae3f-9fa2-41e9-931b-d3e3c20e770e tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.151169 May 27 15:16:07.175697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 225/436] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.245714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.246329 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.252780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.253238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.254037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.254480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.386780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.394397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e393974e-84dd-4a88-9924-8a1695ab558d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1259 microversion: 2.1 time: 0.152449 May 27 15:16:07.394960 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 212/437] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.588212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.588943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.595249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.595701 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.596599 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.596981 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.643338 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.643968 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.651022 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.651482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.652292 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.652933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.789473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.798644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4264c746-398f-47cd-9bf9-1ccc3f6241ae tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.214281 May 27 15:16:07.802288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 226/438] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.834116 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.842012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-02971905-0b29-4dcf-957d-f6b2c9e17fdd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.202520 May 27 15:16:07.842528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 213/439] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:08.192331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.193135 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.199614 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.200060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.200845 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.201282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.332131 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.340776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2d461f9f-e634-4e92-95b1-41ec0cecfc40 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.152380 May 27 15:16:08.341326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 227/440] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.411133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.411845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.418342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.418803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.419570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.420013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.552718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.560358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c21463f4-d206-41f5-8b88-75d4ee99a620 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1444 microversion: 2.1 time: 0.153141 May 27 15:16:08.560953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 214/441] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.577258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.577874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.584735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.585187 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.585953 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.586393 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.716065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.724081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-91d3c82f-f051-4e08-af73-230cdfd390c7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1444 microversion: 2.1 time: 0.150589 May 27 15:16:08.724667 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 228/442] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.815095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.815747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.822876 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.823361 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.824123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.824596 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.859574 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.860241 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.867078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.867614 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.868564 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.869076 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.369381 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.376834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-eed67cd0-a0a6-4e86-9cef-5e741927d732 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.565537 May 27 15:16:09.377765 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 215/443] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.394835 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.395456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.401842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.402301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.403077 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.403524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.407055 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.415485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-036c3051-17b6-42a2-8804-da1587decc14 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.559892 May 27 15:16:09.425123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 229/444] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.561729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:09.592056 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-a4b15917-86b1-4a7c-9e0e-422a87d48101 req-15f637a5-d892-4ef1-b680-90a4b2cdf5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6cd350-0623-438f-9e66-2e086037c8be", "name": "network-vif-plugged", "status": "completed", "tag": "e0325de7-c795-44a6-8a5c-f7ee84487683"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:09.601616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a4b15917-86b1-4a7c-9e0e-422a87d48101 req-15f637a5-d892-4ef1-b680-90a4b2cdf5fc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.602318 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-a4b15917-86b1-4a7c-9e0e-422a87d48101 req-15f637a5-d892-4ef1-b680-90a4b2cdf5fc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.614326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-a4b15917-86b1-4a7c-9e0e-422a87d48101 req-15f637a5-d892-4ef1-b680-90a4b2cdf5fc service nova] Creating event network-vif-plugged:e0325de7-c795-44a6-8a5c-f7ee84487683 for instance bf6cd350-0623-438f-9e66-2e086037c8be on hv-cinder-84254 May 27 15:16:09.620046 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-a4b15917-86b1-4a7c-9e0e-422a87d48101 req-15f637a5-d892-4ef1-b680-90a4b2cdf5fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 May 27 15:16:09.620977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 230/445] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:09.621945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.643014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d86df0bc-2b77-4500-b073-eaab6ba18e31 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.264503 May 27 15:16:09.650756 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 216/446] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.395117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.396569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.403972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.404520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.405362 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.406180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.433114 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.433715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.441058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.441522 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.442424 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.443512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.712709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.720499 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4d8327df-0fe1-4caa-ace0-86d6e9a73fe9 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1367 microversion: 2.1 time: 0.330143 May 27 15:16:10.730643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 231/447] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.730960 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.731431 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.731431 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.734696 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.735151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.735765 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a4277fb8-f269-423d-a40c-c6102b59cb42 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1675 microversion: 2.1 time: 0.306222 May 27 15:16:10.735963 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.736396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.736929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 217/448] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1675 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.960569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.968771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1fff284b-40e0-493a-b93f-144db9995ea7 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.246424 May 27 15:16:10.969336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 232/449] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:11.140235 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-ea246fd5-2a01-481d-bc87-c05274cd27d8 req-df4133a2-f8c6-45dd-a36d-29556457d34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:11.149764 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-ea246fd5-2a01-481d-bc87-c05274cd27d8 req-df4133a2-f8c6-45dd-a36d-29556457d34e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.150311 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-ea246fd5-2a01-481d-bc87-c05274cd27d8 req-df4133a2-f8c6-45dd-a36d-29556457d34e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.163569 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-ea246fd5-2a01-481d-bc87-c05274cd27d8 req-df4133a2-f8c6-45dd-a36d-29556457d34e service nova] Creating event network-changed:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:16:11.169232 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-ea246fd5-2a01-481d-bc87-c05274cd27d8 req-df4133a2-f8c6-45dd-a36d-29556457d34e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032770 May 27 15:16:11.170252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 218/450] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:11.738493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.739778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.742477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:11.750256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.750760 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.751805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.752427 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.760196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.761634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.769125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.769867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.771442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.772236 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.775951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:11.778970 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:11.946220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.954298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe6c6f1b-81a7-4c1a-9d2e-f45f3aed3402 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1556 microversion: 2.1 time: 0.219929 May 27 15:16:11.954878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 233/451] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:11.971129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.971754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.973699 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.978077 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.978622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.979544 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.980133 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.983352 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-85cd580b-b7e8-4160-926e-6cd8c8b03d55 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1652 microversion: 2.1 time: 0.232827 May 27 15:16:11.983929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 219/452] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1652 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:11.988872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.990032 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.996648 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.998186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.999355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.000002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.099595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-44d45568-87bd-4b92-983e-910b739a1fce tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132091 May 27 15:16:12.101430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 234/453] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:12.107575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c4017662-f7a2-4e14-b84c-ca660a60ae31 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:12.115301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4017662-f7a2-4e14-b84c-ca660a60ae31 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.116059 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4017662-f7a2-4e14-b84c-ca660a60ae31 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.149423 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c4017662-f7a2-4e14-b84c-ca660a60ae31 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Going to try to start instance {{(pid=117642) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:16:12.183476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.195687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b4db9c82-840a-4a1e-9d2c-ca5ae3c32497 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.210464 May 27 15:16:12.197417 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 220/454] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:12.214866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c4017662-f7a2-4e14-b84c-ca660a60ae31 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action" status: 202 len: 0 microversion: 2.1 time: 0.111824 May 27 15:16:12.215471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 235/455] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:16:12 2022] POST /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:12.225485 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.226101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.233471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.233934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.235024 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.235987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.392729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.401428 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-07ff4b83-3724-44f2-9201-0b7a854e9967 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1661 microversion: 2.1 time: 0.180644 May 27 15:16:12.401999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 221/456] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1661 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:13.153078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-00eb8ceb-a1f2-4498-abb4-7dd501698eb7 req-167a07f7-5966-4d33-b6fd-3090924ce594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf6cd350-0623-438f-9e66-2e086037c8be", "tag": "e0325de7-c795-44a6-8a5c-f7ee84487683"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:13.163446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-00eb8ceb-a1f2-4498-abb4-7dd501698eb7 req-167a07f7-5966-4d33-b6fd-3090924ce594 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.164257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-00eb8ceb-a1f2-4498-abb4-7dd501698eb7 req-167a07f7-5966-4d33-b6fd-3090924ce594 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.182657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-00eb8ceb-a1f2-4498-abb4-7dd501698eb7 req-167a07f7-5966-4d33-b6fd-3090924ce594 service nova] Creating event network-changed:e0325de7-c795-44a6-8a5c-f7ee84487683 for instance bf6cd350-0623-438f-9e66-2e086037c8be on hv-cinder-84254 May 27 15:16:13.188547 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-00eb8ceb-a1f2-4498-abb4-7dd501698eb7 req-167a07f7-5966-4d33-b6fd-3090924ce594 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039871 May 27 15:16:13.189696 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 236/457] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:13.215316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.217309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.225346 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.225800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.226581 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.227246 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.362347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.371114 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6a28fd4f-cd8c-43d2-bbd0-66fb1b319fca tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.160661 May 27 15:16:13.371674 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 222/458] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.419477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.420895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.428989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.430847 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.432485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.433180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.744911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.753538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7ce9740e-04ed-4dae-b42d-a720d499f64a tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1661 microversion: 2.1 time: 0.338205 May 27 15:16:13.754198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 237/459] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1661 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:14.388823 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.389448 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.396495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.397045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.397881 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.398326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.530638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.539200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d74c2571-a0e7-4912-a18c-01d9b008f323 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1733 microversion: 2.1 time: 0.154197 May 27 15:16:14.539768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 223/460] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:14.771964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.772557 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.779090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.779539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.780301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.780773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.910084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.918274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f820d8b5-8c14-462d-97a3-9f3d95f82cd5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1661 microversion: 2.1 time: 0.151043 May 27 15:16:14.918832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 238/461] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:15.557643 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.558249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.564751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.565199 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.565955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.566392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.695030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:15.702875 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-42c005fb-fda9-4f3f-967d-99715611730b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1713 microversion: 2.1 time: 0.149113 May 27 15:16:15.703431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 224/462] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:15.806084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.806600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.812985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.813451 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.814218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.814662 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.896775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] HTTP exception thrown: Cannot 'detach_volume' instance dc3e5216-919a-4963-93ed-d2785f1d8a48 while it is in vm_state rescued May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Request method failure captured: May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments/936809db-4c9d-4d7d-886e-a6628e64492c HTTP/1.1 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpQpBZVsnDGdmplgtPlCdPQTocc2RyKQ4d1DmoYtpJSdgBDsLpH6sl-lhrkSjw-E_5andgJQY03fKCKoS3_grQxWDdY8VlXgOScqFJveXHANQhMgcEMoFaZvsszy18OseTJXCEc9IAjFe2oi-7k9QujihxLsLHnPiVkgycx8GTQZTg May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: c162124048a34243867e236c81a70eb0 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:16:15.898370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c162124048a34243867e236c81a70eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c162124048a34243867e236c81a70eb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: c162124048a34243867e236c81a70eb0 May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d25dc63e8a4c4af8af2fe29b7819212b May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:16:15.899903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Cannot 'detach_volume' instance dc3e5216-919a-4963-93ed-d2785f1d8a48 while it is in vm_state rescued May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'server_id': 'dc3e5216-919a-4963-93ed-d2785f1d8a48', 'id': '936809db-4c9d-4d7d-886e-a6628e64492c'} May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:15.900613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dc3e5216-919a-4963-93ed-d2785f1d8a48 while it is in vm_state rescued May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dc3e5216-919a-4963-93ed-d2785f1d8a48 while it is in vm_state rescued May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:16:15.902074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Returning 409 to user: Cannot 'detach_volume' instance dc3e5216-919a-4963-93ed-d2785f1d8a48 while it is in vm_state rescued {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:15.903377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a9f920f2-ded2-4a27-b37b-3cacaa819832 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments/936809db-4c9d-4d7d-886e-a6628e64492c" status: 409 len: 152 microversion: 2.1 time: 0.097832 May 27 15:16:15.903377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 239/463] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:16:15 2022] DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments/936809db-4c9d-4d7d-886e-a6628e64492c => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:16:15.908749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:15.909285 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.915882 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.916329 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.917116 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.917555 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.931280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=100 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:15.935679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.936310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.943731 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.944142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.944944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.945386 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.987454 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-720cc69f-8f90-491f-964a-e129e17ad504 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/action" status: 202 len: 0 microversion: 2.1 time: 0.082463 May 27 15:16:15.991397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 225/464] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:16:15 2022] POST /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:15.996867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.997568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:16.003783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.004242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.005751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.006373 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.130408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.138108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7f45980b-a902-40df-8c55-89e19aced131 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1661 microversion: 2.1 time: 0.206962 May 27 15:16:16.138661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 240/465] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1661 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:16.181011 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.189378 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7cb86f52-5368-4b81-89d8-604ba090bbfd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1721 microversion: 2.1 time: 0.196585 May 27 15:16:16.189972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 226/466] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:17.154974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:17.155612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:17.162511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.162957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.163709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.164137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.207177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:17.207822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:17.214544 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.215037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.215920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.216365 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.359030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.367350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30ca6d58-61a2-469d-957c-5670db899a1f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1665 microversion: 2.1 time: 0.216093 May 27 15:16:17.367927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 241/467] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:17.386814 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.394742 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7fd27fa3-1272-4b9b-b38e-9485e07e80f5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1721 microversion: 2.1 time: 0.191246 May 27 15:16:17.395299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 227/468] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:18.411491 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.412104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.418921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.419371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.420130 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.420593 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.554093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.562165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9511876f-1da3-414f-a210-0bba8d292604 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1721 microversion: 2.1 time: 0.154509 May 27 15:16:18.562762 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 242/469] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:19.579172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.579779 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:19.586424 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.586882 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.587645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.588084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.720510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:19.729177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9d12e4fa-f846-4804-977c-a1838a245c1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1727 microversion: 2.1 time: 0.153921 May 27 15:16:19.729731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 228/470] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:19.746025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.746501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:19.752893 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.753337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.754087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.754520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.832741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-84e7e525-2ace-4f96-8c5e-48d0ee3af0c8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090371 May 27 15:16:19.833332 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 243/471] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:20.939154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-bf356227-2c5e-4460-a205-e401be792cd0 req-fa8ae99c-d82c-4861-ad4c-81014e85da87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:20.953292 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bf356227-2c5e-4460-a205-e401be792cd0 req-fa8ae99c-d82c-4861-ad4c-81014e85da87 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.953738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bf356227-2c5e-4460-a205-e401be792cd0 req-fa8ae99c-d82c-4861-ad4c-81014e85da87 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.964985 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-bf356227-2c5e-4460-a205-e401be792cd0 req-fa8ae99c-d82c-4861-ad4c-81014e85da87 service nova] Creating event network-changed:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:16:20.970082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-bf356227-2c5e-4460-a205-e401be792cd0 req-fa8ae99c-d82c-4861-ad4c-81014e85da87 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 May 27 15:16:20.971086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 229/472] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:22.984937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-6f650cbe-62a9-4b50-9cdc-c7b7b17c561b req-ea3982d0-18e6-43d6-8c3d-0956a2fc74f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:22.993212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6f650cbe-62a9-4b50-9cdc-c7b7b17c561b req-ea3982d0-18e6-43d6-8c3d-0956a2fc74f9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.993660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-6f650cbe-62a9-4b50-9cdc-c7b7b17c561b req-ea3982d0-18e6-43d6-8c3d-0956a2fc74f9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.004538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-6f650cbe-62a9-4b50-9cdc-c7b7b17c561b req-ea3982d0-18e6-43d6-8c3d-0956a2fc74f9 service nova] Creating event network-changed:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:16:23.009586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-6f650cbe-62a9-4b50-9cdc-c7b7b17c561b req-ea3982d0-18e6-43d6-8c3d-0956a2fc74f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029031 May 27 15:16:23.010157 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 244/473] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:23.667532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:23.668586 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:23.674982 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.675467 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.676231 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.676743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.747612 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e268e714-1c72-4332-9edc-025a0692ba67 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action" status: 202 len: 0 microversion: 2.1 time: 0.084704 May 27 15:16:23.748251 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 230/474] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:16:23 2022] POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:16:23.756931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:23.758185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:23.764562 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.765019 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.765866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.766348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.008368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.016622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6607d52c-9a00-4bae-a4d8-1798bdd7542b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1750 microversion: 2.1 time: 0.263960 May 27 15:16:24.017317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 245/475] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:23 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1750 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:25.035552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:25.036990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:25.043277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.043736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.044533 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.044979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.187663 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:25.195718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-317331b8-cb19-467d-8073-2888479d20eb tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.164960 May 27 15:16:25.196275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 231/476] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:25 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:26.213284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:26.213921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:26.220708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:26.221185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.222002 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:26.222572 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.368196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.376202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7310e081-db74-4342-b862-b47ae9caf268 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.166857 May 27 15:16:26.376828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 246/477] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:26 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:27.392986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.393595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.401311 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.401758 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.402510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.402943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.548064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.556652 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a993cca9-2c6a-4c40-ba96-afc301855a12 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.167444 May 27 15:16:27.557213 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 232/478] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:28.574068 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.574674 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.581160 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.581606 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.582358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.582834 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.727330 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.735152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b06c3afe-930c-4608-b485-dac4055636f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.164939 May 27 15:16:28.735710 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 247/479] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:29.753759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:29.754331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:29.762096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.762551 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.763326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.763772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.919858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.928196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ebc43c5d-eb07-440a-ae0c-04069ce08ca4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.178624 May 27 15:16:29.928856 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 233/480] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:29 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:30.947016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.947645 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.950059 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:30.955611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.956054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.956834 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.957265 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.099628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.107474 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-84c4ade8-06ff-4100-ba84-83ee2a589e5f tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.165188 May 27 15:16:31.108032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 248/481] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:32.124918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.125537 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.127927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=73 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:32.134308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.134760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.135527 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.135964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.282037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.290583 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4a4650f2-731a-4b03-98e9-038f800c0022 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.169697 May 27 15:16:32.291145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 234/482] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:33.307168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.307775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.314404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.314849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.315603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.316038 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.465020 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:33.473060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4f4a19b2-3a53-438f-a0c1-f26e14f1a050 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.169748 May 27 15:16:33.473882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 249/483] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:34.490621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.491229 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.497643 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.498094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.498868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.499309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.643166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.651935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-77455664-d651-472c-89d0-0ee036e84cf6 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.165507 May 27 15:16:34.652514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 235/484] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:35.669331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.669878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.676974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.677507 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.678277 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.678714 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.818186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.820365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:35.827710 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e6be04b8-e7b9-406a-9420-437035df3585 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.162946 May 27 15:16:35.828274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 250/485] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:36.846041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.846657 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.853920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.854378 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.855148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.855587 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.996178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.004274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5d7a4fe7-8db4-4dd4-aef8-d38aac5be27a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.162467 May 27 15:16:37.005043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 236/486] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.022007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.022692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.030438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.030888 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.031654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.032093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.175720 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:38.184143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-155da969-ad45-4d2e-9d69-866cfa5ea519 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.166424 May 27 15:16:38.184735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 251/487] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:39.201703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.202335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.210019 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.210467 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.211224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.211656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.353303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.361122 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1c45a9ad-ae9c-44ea-a717-b437fa9745f0 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.163311 May 27 15:16:39.361680 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 237/488] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:40.378741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.379949 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.386984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.387108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.387788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.388221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.533103 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.542269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e49a391f-08e2-40f0-9f53-57eb03a28dde tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1755 microversion: 2.1 time: 0.167400 May 27 15:16:40.542823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 252/489] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:41.559644 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.560254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.567326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.567780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.568557 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.568992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.711256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:41.719741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f9c1cfcb-b341-44a6-b87c-249df9495b96 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1758 microversion: 2.1 time: 0.163905 May 27 15:16:41.720298 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 238/490] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.951291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.951891 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.954995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=9 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:57.955809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:57.960215 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.960699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.961473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.961912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.986289 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aa9e6bb1-1ad7-4555-bc8b-197483c73dcb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/ips" status: 200 len: 148 microversion: 2.1 time: 0.038806 May 27 15:16:57.986856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 253/491] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:59.184639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.185639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.189307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=9 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:59.190308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:59.195756 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.196315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.197273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.197783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.230002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0aa67504-ba8e-47ed-af8b-7acb3606db0f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049513 May 27 15:16:59.230715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 239/492] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:16:59.299047 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.299559 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.307071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.307569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.308495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.308942 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.318453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5251ac32-94d5-436f-9772-c7d9cb8ddfe5"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:59.319549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.325528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.325979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.326740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.327174 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.334896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:59.423114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f5228fff-7fcf-4dd5-97a6-8cca72e0350c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 204 len: 0 microversion: 2.1 time: 0.127290 May 27 15:16:59.423887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 254/493] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:16:59 2022] DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:59.433444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.434210 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.440229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.440736 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.441535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.441976 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.626104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.633762 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a740530-6339-4af8-9080-221183b42f4c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1671 microversion: 2.1 time: 0.204713 May 27 15:16:59.634340 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 255/494] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:00.651755 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.652425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.659511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.659961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.661180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.661628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.788073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.795503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-76fe3220-c0ba-403d-b042-5f0b0ecbd66d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1671 microversion: 2.1 time: 0.148159 May 27 15:17:00.796071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 256/495] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:01.695568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7da7fc54-515c-4324-b102-ef161bafcfbb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.381875 May 27 15:17:01.696210 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 240/496] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:16:59 2022] POST /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments => generated 194 bytes in 2383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:01.815846 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.817132 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.828898 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.829356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.830130 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.830587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.983354 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.990974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-019b0310-8c16-4410-8ec6-b9a5471c8e88 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1671 microversion: 2.1 time: 0.180930 May 27 15:17:01.991527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 257/497] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.010036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:03.010745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:03.016957 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.017414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.018184 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.018623 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.128684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:03.136492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b0f7173f-b1c1-4eca-9f11-b61f68a46656 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 200 len: 1604 microversion: 2.1 time: 0.131174 May 27 15:17:03.137054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 241/498] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:03 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.380196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-bb417a97-4149-4ff9-9c71-256213fd656e req-307371ab-fd2b-45c7-aecb-54e77d527f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90285ea2-a28f-4844-9a8a-652ecafc72ef", "name": "network-vif-deleted", "tag": "5737ab7a-1d8d-4ce7-85ab-97d0a121905d"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:03.401311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-bb417a97-4149-4ff9-9c71-256213fd656e req-307371ab-fd2b-45c7-aecb-54e77d527f62 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.403058 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-bb417a97-4149-4ff9-9c71-256213fd656e req-307371ab-fd2b-45c7-aecb-54e77d527f62 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.428273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-bb417a97-4149-4ff9-9c71-256213fd656e req-307371ab-fd2b-45c7-aecb-54e77d527f62 service nova] Creating event network-vif-deleted:5737ab7a-1d8d-4ce7-85ab-97d0a121905d for instance 90285ea2-a28f-4844-9a8a-652ecafc72ef on hv-cinder-84254 May 27 15:17:03.439617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-bb417a97-4149-4ff9-9c71-256213fd656e req-307371ab-fd2b-45c7-aecb-54e77d527f62 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076593 May 27 15:17:03.442106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 258/499] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:04.154666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.155279 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.162582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.163039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.163851 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.164295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.180691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef HTTP/1.1 May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:17:04.182355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:17:04.184175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '90285ea2-a28f-4844-9a8a-652ecafc72ef'} May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:04.185130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:17:04.186443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:04.187606 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:04.187606 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ffbb18c2-6f40-4273-8808-88afdabe2898 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 404 len: 111 microversion: 2.1 time: 0.033111 May 27 15:17:04.187606 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 242/500] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:04 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:04.193732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe078994-2192-4554-be32-84ae619013b3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '.version_select at 0x7fa3720b0f70>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.212204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe078994-2192-4554-be32-84ae619013b3 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448927253" status: 202 len: 0 microversion: 2.1 time: 0.022725 May 27 15:17:04.212883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 259/501] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 15:17:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448927253 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:04.854882 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f80a578f-00a8-40f3-b20e-69b3a3f742ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: .version_select at 0x7fa3727499d0>, body: {"keypair": {"name": "tempest-keypair-1489358213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNH7DqyUYpha2ifYJpcZe+2L2OE21r60rkyZQUOZb8L+q1BXk7IrtgudIShZbDT0Hdh7xRKu9VwUIxGpYwIFZohZbDEY9C9uh6kyCl+Zjtt5itOPuwtEIok+zzYyeMsVg=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:04.869950 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-f80a578f-00a8-40f3-b20e-69b3a3f742ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for project 72d5173b32b5480790babb3d178b94fb. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:04.873716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-f80a578f-00a8-40f3-b20e-69b3a3f742ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for user 097084a3e57540d18bae448da3b3ecc4 and project 72d5173b32b5480790babb3d178b94fb. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:04.896690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f80a578f-00a8-40f3-b20e-69b3a3f742ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045617 May 27 15:17:04.897283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 243/502] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:17:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:06.211948 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1771120344", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa7d805a-200a-417c-8552-13b168c382aa"}], "security_groups": [{"name": "tempest-securitygroup--187095658"}], "key_name": "tempest-keypair-1489358213", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:06.313417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] validate_networks() for [('fa7d805a-200a-417c-8552-13b168c382aa', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:06.687775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:06.688206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:06.688746 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:06.689163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:06.689579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:06.699041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.699488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.700309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.700797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.717976 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for project 72d5173b32b5480790babb3d178b94fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:06.721921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Getting quotas for user 097084a3e57540d18bae448da3b3ecc4 and project 72d5173b32b5480790babb3d178b94fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:06.733558 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:06.735931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:06.781946 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ee6c1a1-84c2-4f4c-a1f9-3a68822c6950 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574948 May 27 15:17:06.782572 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 260/503] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:17:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:06.793505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-02c79ace-9390-4347-ac6e-e285909e63ac tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.794259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-02c79ace-9390-4347-ac6e-e285909e63ac tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.856073 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-02c79ace-9390-4347-ac6e-e285909e63ac tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.862617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-02c79ace-9390-4347-ac6e-e285909e63ac tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1238 microversion: 2.1 time: 0.073116 May 27 15:17:06.863298 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 244/504] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:07.881316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:07.881936 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:07.888922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.889381 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.890174 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.890615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.956654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:07.965055 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-203fbc74-068b-49df-a851-d23450aaf69d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1290 microversion: 2.1 time: 0.088941 May 27 15:17:07.965646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 261/505] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:07 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:08.984033 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:08.984798 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:08.992266 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.992845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.993676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.994153 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.072917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.080508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1b4a2d37-0851-4b1a-987f-6ed75e30d3b8 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1296 microversion: 2.1 time: 0.100533 May 27 15:17:09.081081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 245/506] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:08 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.239057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5251ac32-94d5-436f-9772-c7d9cb8ddfe5"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:09.240183 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.247190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.247685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.248520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.248974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.346873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments HTTP/1.1 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 74 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:17:09.349449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {"volumeAttachment": {"volumeId": "5251ac32-94d5-436f-9772-c7d9cb8ddfe5"}} May 27 15:17:09.350975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'server_id': 'bf6cd350-0623-438f-9e66-2e086037c8be', 'body': {'volumeAttachment': {'volumeId': '5251ac32-94d5-436f-9772-c7d9cb8ddfe5'}}} May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:09.351770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.352923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 400 to user: Invalid volume: volume 5251ac32-94d5-436f-9772-c7d9cb8ddfe5 is already attached to instances: bf6cd350-0623-438f-9e66-2e086037c8be {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9636a129-2bd0-433d-aec8-1d7bf797c847 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115928 May 27 15:17:09.354300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 262/507] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:17:09 2022] POST /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:17:09.422261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.422979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.429941 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.430391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.431160 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.431595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.520791 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lazy-loading 'services' on Instance uuid bf6cd350-0623-438f-9e66-2e086037c8be {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:09.593328 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-38872a49-9ada-4d3d-8759-b43e3c948c3d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments/5251ac32-94d5-436f-9772-c7d9cb8ddfe5" status: 202 len: 0 microversion: 2.1 time: 0.174787 May 27 15:17:09.593980 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 246/508] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:17:09 2022] DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments/5251ac32-94d5-436f-9772-c7d9cb8ddfe5 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:09.603887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.604943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.611768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.612560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.613443 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.614315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.647978 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-157e84fb-5095-4979-9a5c-e597a9ceeed4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 May 27 15:17:09.648845 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 263/509] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:09.989244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-6e56b27d-4f21-4543-b207-77bd8b05f53e req-346c1214-e1c4-43b6-8277-fe2857776021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6a2750-8fc3-4343-9fb3-aa9177dd01a7", "tag": "8ce3e0a8-1883-4f25-97d5-3b1fd586b141"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:10.008914 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-6e56b27d-4f21-4543-b207-77bd8b05f53e req-346c1214-e1c4-43b6-8277-fe2857776021 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.009480 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-6e56b27d-4f21-4543-b207-77bd8b05f53e req-346c1214-e1c4-43b6-8277-fe2857776021 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.033041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-6e56b27d-4f21-4543-b207-77bd8b05f53e req-346c1214-e1c4-43b6-8277-fe2857776021 service nova] Creating event network-changed:8ce3e0a8-1883-4f25-97d5-3b1fd586b141 for instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 on hv-cinder-84254 May 27 15:17:10.039274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-6e56b27d-4f21-4543-b207-77bd8b05f53e req-346c1214-e1c4-43b6-8277-fe2857776021 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054169 May 27 15:17:10.040170 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 247/510] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:10.098449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.099127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.106337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.107126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.108006 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.108585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.336209 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.343878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c68ddb98-d7c5-4af5-9d47-e12a3455b6f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.249387 May 27 15:17:10.353431 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 264/511] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:10.661171 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.662232 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.668722 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.669180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.669973 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.670451 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.699768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-254a7218-20fa-465c-af11-85824cba77e4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043530 May 27 15:17:10.700308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 248/512] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:17:10.758172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.758699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.764905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.765295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.766050 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.766482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.791503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:10.867052 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58266acb-615f-4cae-bbf9-b42e3d1baf30 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 204 len: 0 microversion: 2.1 time: 0.112600 May 27 15:17:10.867630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 265/513] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:17:10 2022] DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:10.875732 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.876372 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.882483 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.882936 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.883734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.884175 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.015862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.023930 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d95f6203-5b8f-4b24-84c8-c1c0e0b56a02 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1680 microversion: 2.1 time: 0.152048 May 27 15:17:11.024509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 249/514] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:11.361652 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.362350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.368850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.369302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.370060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.370496 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.498703 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.506204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-da4c1014-48c3-43f9-bf8a-8a80ddad8cbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.148780 May 27 15:17:11.506762 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 266/515] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:12.040372 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:12.040938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:12.047486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.047938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:12.048734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.049180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:12.181552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.188953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f46f5162-43e5-44a1-8ea1-9e7ebe5d3b84 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1680 microversion: 2.1 time: 0.152671 May 27 15:17:12.189514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 250/516] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:12 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:12.577828 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:12.578431 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:12.585028 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.585475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:12.586224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.586655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:12.712145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.719654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9196d068-ef8e-45fe-9916-a616f197cbe2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.200463 May 27 15:17:12.720205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 267/517] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:12 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:13.206043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:13.206642 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:13.213782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.214241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.215016 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.215460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.738795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:13.739902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:13.746091 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.746757 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.747802 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.748388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.771800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:13.784030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d03f8280-703e-47c6-891c-28d9efc4b0d0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1680 microversion: 2.1 time: 0.581825 May 27 15:17:13.785477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 251/518] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:13 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.049205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.054216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:14.059886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e2d7bc47-8e04-435d-b691-fb899042d556 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.325942 May 27 15:17:14.060725 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 268/519] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:13 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.563808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-4ccd0a3a-1023-46b9-8b3a-ddf1aa355342 req-03c380c4-d59b-4f84-8af1-db44f6561bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6cd350-0623-438f-9e66-2e086037c8be", "name": "network-vif-deleted", "tag": "e0325de7-c795-44a6-8a5c-f7ee84487683"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:14.574346 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4ccd0a3a-1023-46b9-8b3a-ddf1aa355342 req-03c380c4-d59b-4f84-8af1-db44f6561bb9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.574921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4ccd0a3a-1023-46b9-8b3a-ddf1aa355342 req-03c380c4-d59b-4f84-8af1-db44f6561bb9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.588571 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-4ccd0a3a-1023-46b9-8b3a-ddf1aa355342 req-03c380c4-d59b-4f84-8af1-db44f6561bb9 service nova] Creating event network-vif-deleted:e0325de7-c795-44a6-8a5c-f7ee84487683 for instance bf6cd350-0623-438f-9e66-2e086037c8be on hv-cinder-84254 May 27 15:17:14.594388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-4ccd0a3a-1023-46b9-8b3a-ddf1aa355342 req-03c380c4-d59b-4f84-8af1-db44f6561bb9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034744 May 27 15:17:14.595007 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 252/520] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:14.801905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.802449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.810198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.810649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.811417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.811858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.845733 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.846182 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.846632 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lazy-loading 'fault' on Instance uuid bf6cd350-0623-438f-9e66-2e086037c8be {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:14.895416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.904035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-48558830-a0b3-417a-b9ba-b6cdc0098e92 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 200 len: 1331 microversion: 2.1 time: 0.106520 May 27 15:17:14.916474 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 269/521] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:15.078213 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:15.078976 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:15.085288 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.085762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.086533 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.086974 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.244834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.252597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ec3120b7-d301-4aa1-8cd6-33e21ff8f910 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.178519 May 27 15:17:15.253169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 253/522] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:15 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:15.885799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-7a6b85f8-03a0-47a8-bb9f-8f015bee2950 req-0b16cc5d-c6a4-49ef-a0c2-852a734d4121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6a2750-8fc3-4343-9fb3-aa9177dd01a7", "name": "network-vif-plugged", "status": "completed", "tag": "8ce3e0a8-1883-4f25-97d5-3b1fd586b141"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:15.895306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7a6b85f8-03a0-47a8-bb9f-8f015bee2950 req-0b16cc5d-c6a4-49ef-a0c2-852a734d4121 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.895770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-7a6b85f8-03a0-47a8-bb9f-8f015bee2950 req-0b16cc5d-c6a4-49ef-a0c2-852a734d4121 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.907168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-7a6b85f8-03a0-47a8-bb9f-8f015bee2950 req-0b16cc5d-c6a4-49ef-a0c2-852a734d4121 service nova] Creating event network-vif-plugged:8ce3e0a8-1883-4f25-97d5-3b1fd586b141 for instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 on hv-cinder-84254 May 27 15:17:15.912088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-7a6b85f8-03a0-47a8-bb9f-8f015bee2950 req-0b16cc5d-c6a4-49ef-a0c2-852a734d4121 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029955 May 27 15:17:15.912718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 270/523] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:15.926934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:15.927632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:15.934655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.935351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.936134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.936807 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.952286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be HTTP/1.1 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:17:15.953986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:17:15.955519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'bf6cd350-0623-438f-9e66-2e086037c8be'} May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:15.956374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:17:15.958473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:15.959830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:15.959830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fc51acb6-1b38-4a15-9715-0f45023fb4f8 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 404 len: 111 microversion: 2.1 time: 0.032379 May 27 15:17:15.959830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 254/524] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:15 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:15.965909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d82c8497-113f-46a9-95e7-e4d5950b1dda tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '.version_select at 0x7fa371db41f0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:15.985117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d82c8497-113f-46a9-95e7-e4d5950b1dda tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194488962" status: 202 len: 0 microversion: 2.1 time: 0.023082 May 27 15:17:15.986282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 271/525] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 15:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194488962 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:16.270375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:16.271147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:16.277449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.277917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.278817 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.279271 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.410772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.418325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c9711ead-b0fc-4e4e-8815-f1c020639db9 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1363 microversion: 2.1 time: 0.152385 May 27 15:17:16.418896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 255/526] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:16 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:16.681256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c3654aaa-29ca-4f94-8391-27d0461879f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: .version_select at 0x7fa371ded280>, body: {"keypair": {"name": "tempest-keypair-575703615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcPM2kCiOgGB9MhBjUFJxGPI4o3GoGeGLu6NsLGkZHreOmhc+oOmbaVyfSbXWBIzvg+225XCrhSzyRowSLjgimNDf84Ye8gHaxAyQO5LKT8pe54R3k49d3eg6j3TSOCXw=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:16.696026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-c3654aaa-29ca-4f94-8391-27d0461879f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:16.699989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-c3654aaa-29ca-4f94-8391-27d0461879f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:16.709488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:16.725793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c3654aaa-29ca-4f94-8391-27d0461879f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048609 May 27 15:17:16.726396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 272/527] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:17:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:17.435750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:17.436366 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:17.438442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:17.445197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.445651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.446590 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.447192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.667064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:17.676576 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-27f5e684-fbc6-464a-9d4d-2e2cb08777ae tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1549 microversion: 2.1 time: 0.244768 May 27 15:17:17.677614 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 256/528] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:17 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:17.695470 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:17.696092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:17.703211 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.703670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.704440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.704907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.822180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-322ca5ef-032a-4bbc-84ee-b2a83c67390d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132487 May 27 15:17:17.822934 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 273/529] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:17:17 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:18.104641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1766775731", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25b92ae9-fc97-4437-8dc2-335b8971db2a"}], "security_groups": [{"name": "tempest-securitygroup--1340299191"}], "key_name": "tempest-keypair-575703615", "user_data": "}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:18.208427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] validate_networks() for [('25b92ae9-fc97-4437-8dc2-335b8971db2a', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:18.649791 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:18.650383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:18.650714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:18.651124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:18.651538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:18.661795 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.662241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.663074 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.667758 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.684397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:18.688967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Getting quotas for user ced10e76e5cc4443819157c821f82226 and project cc1a70bd2ce64fbcb738a2cfcfb09f41. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:18.702270 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:18.704593 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:18.762827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6df94dd7-4fd7-4823-ba35-6eb6c6f3d590 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.662441 May 27 15:17:18.771178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 257/530] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:17:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:18.774323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ac5cb51e-6385-401d-8352-43530fa6e5db tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:18.775354 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ac5cb51e-6385-401d-8352-43530fa6e5db tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:18.812930 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-ff94d5d6-8d55-4109-85de-f33d1750ba8b req-0a676c29-28cd-4a10-90aa-40eab8e1a83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6a2750-8fc3-4343-9fb3-aa9177dd01a7", "tag": "8ce3e0a8-1883-4f25-97d5-3b1fd586b141"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:18.822775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-ff94d5d6-8d55-4109-85de-f33d1750ba8b req-0a676c29-28cd-4a10-90aa-40eab8e1a83a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.823364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-ff94d5d6-8d55-4109-85de-f33d1750ba8b req-0a676c29-28cd-4a10-90aa-40eab8e1a83a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.834972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-ff94d5d6-8d55-4109-85de-f33d1750ba8b req-0a676c29-28cd-4a10-90aa-40eab8e1a83a service nova] Creating event network-changed:8ce3e0a8-1883-4f25-97d5-3b1fd586b141 for instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 on hv-cinder-84254 May 27 15:17:18.840557 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-ff94d5d6-8d55-4109-85de-f33d1750ba8b req-0a676c29-28cd-4a10-90aa-40eab8e1a83a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 May 27 15:17:18.841397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 258/531] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:18.883952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ac5cb51e-6385-401d-8352-43530fa6e5db tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:18.891672 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ac5cb51e-6385-401d-8352-43530fa6e5db tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1241 microversion: 2.1 time: 0.121184 May 27 15:17:18.893092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 274/532] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:18 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:19.911951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:19.913426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:19.922041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:19.923118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.924370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:19.926855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.947525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:19.998396 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:20.007087 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-92395324-26c1-45e6-a2a9-415a1a179229 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1299 microversion: 2.1 time: 0.101052 May 27 15:17:20.007933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 259/533] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:19 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:20.257337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1341750672"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:20.257890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.265293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.265741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.266502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.266929 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.721202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.network.security_group_api [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Removing security group d8d76f4a-c578-47cc-afad-e8384745f9c3 from port 07ab533a-c377-484b-8298-8e84d7500fd8 May 27 15:17:21.024683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:21.025495 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:21.032992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.033573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.034460 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.035031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.343456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.352943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-53e435a7-0092-4e67-9e26-509e44cbd955 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.332563 May 27 15:17:21.353512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 260/534] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:21 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:21.524546 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d90efbdf-f65d-4ebc-ae07-f95484556a80 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action" status: 202 len: 0 microversion: 2.1 time: 1.271392 May 27 15:17:21.531005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 275/535] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:17:20 2022] POST /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/action => generated 0 bytes in 1278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:21.534944 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-85135058-edff-4cc7-869d-cda0b49e42ec req-503ec2ec-56aa-4ff0-8884-2fe3f410368d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:21.544165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-85135058-edff-4cc7-869d-cda0b49e42ec req-503ec2ec-56aa-4ff0-8884-2fe3f410368d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.544645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-85135058-edff-4cc7-869d-cda0b49e42ec req-503ec2ec-56aa-4ff0-8884-2fe3f410368d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.574268 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-85135058-edff-4cc7-869d-cda0b49e42ec req-503ec2ec-56aa-4ff0-8884-2fe3f410368d service nova] Creating event network-changed:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:17:21.589203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-85135058-edff-4cc7-869d-cda0b49e42ec req-503ec2ec-56aa-4ff0-8884-2fe3f410368d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058095 May 27 15:17:21.590140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 261/536] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:22.464050 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.464714 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.471765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.472261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.473073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.473510 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.713923 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.728246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3eb6e817-7ce0-48cc-b844-2abdb7f321fe tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.362129 May 27 15:17:22.730054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 276/537] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:22 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:22.737772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.738759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.745676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.745896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.746676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.747214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.813018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-dee7fcce-3008-4ecd-a449-e66153a05e53 req-d8ec18de-39e7-4880-a02b-9dd803d5c751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:22.824252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-dee7fcce-3008-4ecd-a449-e66153a05e53 req-d8ec18de-39e7-4880-a02b-9dd803d5c751 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.825485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-dee7fcce-3008-4ecd-a449-e66153a05e53 req-d8ec18de-39e7-4880-a02b-9dd803d5c751 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.838388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-dee7fcce-3008-4ecd-a449-e66153a05e53 req-d8ec18de-39e7-4880-a02b-9dd803d5c751 service nova] Creating event network-changed:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:17:22.845556 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-dee7fcce-3008-4ecd-a449-e66153a05e53 req-d8ec18de-39e7-4880-a02b-9dd803d5c751 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105296 May 27 15:17:22.846733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lazy-loading 'services' on Instance uuid 0065699d-fe81-4c03-966a-445d65c3d593 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:22.852724 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 277/538] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:22.937476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c212488b-d9e7-4093-8aa5-319a6036a38a tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments/8b241992-b0be-4a08-ac76-aea930148145" status: 202 len: 0 microversion: 2.1 time: 0.212688 May 27 15:17:22.938198 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 262/539] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:17:22 2022] DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments/8b241992-b0be-4a08-ac76-aea930148145 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:22.947293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.948615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.955108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.955797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.957330 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.957927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.994746 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7056f970-eb8f-4dda-9f0a-4dd993a2a796 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051781 May 27 15:17:22.998979 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 278/540] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:22 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:23.623005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-733a8ce4-19b8-4af2-9f90-6f6c5a5b80d8 req-54841cc6-b89a-459b-a6e8-cf5a90cc15f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044df8fd-2d18-4cca-bfa1-a9f4febd691d", "tag": "539036bd-12f7-44c7-adfe-551cea6b99a2"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:23.631750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-733a8ce4-19b8-4af2-9f90-6f6c5a5b80d8 req-54841cc6-b89a-459b-a6e8-cf5a90cc15f7 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.632219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-733a8ce4-19b8-4af2-9f90-6f6c5a5b80d8 req-54841cc6-b89a-459b-a6e8-cf5a90cc15f7 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.643371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-733a8ce4-19b8-4af2-9f90-6f6c5a5b80d8 req-54841cc6-b89a-459b-a6e8-cf5a90cc15f7 service nova] Creating event network-changed:539036bd-12f7-44c7-adfe-551cea6b99a2 for instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d on hv-cinder-84254 May 27 15:17:23.648264 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-733a8ce4-19b8-4af2-9f90-6f6c5a5b80d8 req-54841cc6-b89a-459b-a6e8-cf5a90cc15f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029435 May 27 15:17:23.649057 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 263/541] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:23.744423 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.745067 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.748758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:23.752907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.753564 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.754624 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.755200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.815099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.815691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.823289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.823749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.824550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.825000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.892308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.900796 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aab19222-a25a-4e4f-8d93-a7db2c7d9540 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.159945 May 27 15:17:23.901353 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 279/542] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:23.906778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lazy-loading 'services' on Instance uuid dc3e5216-919a-4963-93ed-d2785f1d8a48 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:23.978588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-392c78aa-e008-4db5-9a21-54907c5b93e0 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments/936809db-4c9d-4d7d-886e-a6628e64492c" status: 202 len: 0 microversion: 2.1 time: 0.167802 May 27 15:17:23.979173 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 264/543] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:17:23 2022] DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments/936809db-4c9d-4d7d-886e-a6628e64492c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:17:23.987348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.988700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.994660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.995106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.995859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.996288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.007375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:24.008589 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:24.015160 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.015611 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.016394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.016858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.029638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4d06597d-2b6d-4b50-9157-770cc34c5f65 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046081 May 27 15:17:24.030199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 280/544] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:24.046478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4255d260-c021-422d-9af5-4d8a57a98d7b tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 May 27 15:17:24.047037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 265/545] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:24 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:24.917291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:24.918585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:24.926344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.927052 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.928044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.928675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.044239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:25.045789 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.054418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.055005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.055650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.056261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.088830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d3647c4e-8d04-4456-aa9f-1ab674be4a5a tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050202 May 27 15:17:25.089404 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 266/546] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:25 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:25.094468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:25.095377 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.101779 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.102255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.103004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.103448 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.134682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-88156567-d48c-4c49-b6d7-da7da9ea5825 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043806 May 27 15:17:25.135172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 267/547] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:25 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:17:25.147289 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:25.150242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:25.150997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.154720 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2df7da43-3fd6-4b5f-8760-d785f17c0e93 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.241194 May 27 15:17:25.158706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.159860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.160159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.161102 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.164873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 281/548] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:24 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:25.244811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] HTTP exception thrown: Instance 0065699d-fe81-4c03-966a-445d65c3d593 is not attached to volume 8b241992-b0be-4a08-ac76-aea930148145 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Request method failure captured: May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments/8b241992-b0be-4a08-ac76-aea930148145 HTTP/1.1 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOruNGehysb127FrSoJFliM8FuB_SstpEfhbPVAOX5xbujWuie4omN18-DkMXD-zyLDShx_M-EyjEpctIJcwNc3cKD2xPjOBSiH0kXdGrX-LLR207Rs1uwjfnwopL9i8NOoy1ww-VBfQzABbFqB-bhVXAPCdFznVOBJk6Q9xfKgHoUo May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: b9fd239910a6492a953310873fd2379e May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:17:25.247524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b9fd239910a6492a953310873fd2379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b9fd239910a6492a953310873fd2379e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b9fd239910a6492a953310873fd2379e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b9fd239910a6492a953310873fd2379e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: b9fd239910a6492a953310873fd2379e May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestMinimumBasicScenario-1626548889-project May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 943b21e6079646dc9f47dd5698278b34 May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestMinimumBasicScenario-1626548889-project May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:17:25.249277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 0065699d-fe81-4c03-966a-445d65c3d593 is not attached to volume 8b241992-b0be-4a08-ac76-aea930148145 May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'server_id': '0065699d-fe81-4c03-966a-445d65c3d593', 'id': '8b241992-b0be-4a08-ac76-aea930148145'} May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8b241992-b0be-4a08-ac76-aea930148145. May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:25.249999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0065699d-fe81-4c03-966a-445d65c3d593 is not attached to volume 8b241992-b0be-4a08-ac76-aea930148145 May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0065699d-fe81-4c03-966a-445d65c3d593 is not attached to volume 8b241992-b0be-4a08-ac76-aea930148145 May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:17:25.251104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Returning 404 to user: Instance 0065699d-fe81-4c03-966a-445d65c3d593 is not attached to volume 8b241992-b0be-4a08-ac76-aea930148145 {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:25.252032 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ec31d90e-bdc6-4feb-a2e5-9460bb148be4 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments/8b241992-b0be-4a08-ac76-aea930148145" status: 404 len: 154 microversion: 2.1 time: 0.108053 May 27 15:17:25.252032 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 268/549] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:17:25 2022] DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593/os-volume_attachments/8b241992-b0be-4a08-ac76-aea930148145 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:17:26.101082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.102015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.108138 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.108615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.109385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.109825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.141301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d414555a-8921-48cc-a172-4c49d9d88882 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044515 May 27 15:17:26.142058 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 282/550] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:17:26.173114 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.176267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.183699 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.184355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.185384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.185920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.221445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.221939 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.228890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.229355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.230130 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.230570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.255333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:26.326384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.334400 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-91dc3ad0-7860-4699-9b44-1951c62352bf tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.167182 May 27 15:17:26.334976 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 269/551] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:26.337750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41791bc4-a170-47f6-8fcb-bf648475d9e8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 204 len: 0 microversion: 2.1 time: 0.120139 May 27 15:17:26.338389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 283/552] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:17:26 2022] DELETE /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:26.348364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.349096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.355304 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.355875 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.356778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.357232 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.407605 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.408945 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.421686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.421686 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.422761 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.423201 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.451416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:26.510943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.519462 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-92d3a8e9-0ae3-4495-8aff-f7c89a098bb5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1687 microversion: 2.1 time: 0.176414 May 27 15:17:26.520342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 270/553] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:26.533551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c518ad25-c69f-4430-8c15-2230eabccf20 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 204 len: 0 microversion: 2.1 time: 0.131383 May 27 15:17:26.534216 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 284/554] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:17:26 2022] DELETE /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:26.542958 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.543573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.549459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.549906 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.551493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.552012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.679439 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.686871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-186bde16-58f3-48f8-802d-7f8a67fadf79 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1553 microversion: 2.1 time: 0.147788 May 27 15:17:26.687424 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 271/555] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:27.352185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.352905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.359321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.359769 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.360544 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.360972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.495548 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.502940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d26e0727-721f-40c1-85dd-e2faee68fbac tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.155240 May 27 15:17:27.503721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 285/556] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:27.536975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.537588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.543999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.544476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.545242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.545680 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.672413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.680620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-12b21423-54b5-4367-82b2-6b2a7ecf9b1c tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1687 microversion: 2.1 time: 0.148178 May 27 15:17:27.681197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 272/557] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:27.703075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.703622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.710245 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.710698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.711463 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.711903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.845692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.849389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:27.854418 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6ea464d4-b388-4f1f-8de5-66601dfe3237 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1553 microversion: 2.1 time: 0.155241 May 27 15:17:27.854980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 286/558] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:28.079187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-152c1e75-33c1-4dcc-b907-6a39738aa016 req-f6e8f026-4e7f-479f-b971-208f0e052def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044df8fd-2d18-4cca-bfa1-a9f4febd691d", "name": "network-vif-plugged", "status": "completed", "tag": "539036bd-12f7-44c7-adfe-551cea6b99a2"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:28.088552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-152c1e75-33c1-4dcc-b907-6a39738aa016 req-f6e8f026-4e7f-479f-b971-208f0e052def service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.089027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-152c1e75-33c1-4dcc-b907-6a39738aa016 req-f6e8f026-4e7f-479f-b971-208f0e052def service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.101411 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-152c1e75-33c1-4dcc-b907-6a39738aa016 req-f6e8f026-4e7f-479f-b971-208f0e052def service nova] Creating event network-vif-plugged:539036bd-12f7-44c7-adfe-551cea6b99a2 for instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d on hv-cinder-84254 May 27 15:17:28.106326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-152c1e75-33c1-4dcc-b907-6a39738aa016 req-f6e8f026-4e7f-479f-b971-208f0e052def service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 May 27 15:17:28.106919 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 273/559] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:28.521865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.522534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.529454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.529896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.530642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.531070 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.661012 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.668605 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-30adbe9a-453c-4ee6-9fae-69976e0fc6fb tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.152041 May 27 15:17:28.669171 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 287/560] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:28.695223 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:28.699714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.700412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.702177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:28.704349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:28.710095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.710549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.711321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.711759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.840852 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.849122 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-206b959a-eb7d-44bc-81db-bbfef7e59c8f tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1687 microversion: 2.1 time: 0.155284 May 27 15:17:28.849685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 274/561] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:28.871026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.871635 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.877610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.878066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.879005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.879450 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.894026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=12 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:29.011281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:29.019264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-49369343-919d-4f0a-8af9-6727cd884673 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1553 microversion: 2.1 time: 0.151664 May 27 15:17:29.019820 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 288/562] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:29.686240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:29.686875 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:29.693449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.693903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.694672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.695117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.840110 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:29.848110 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-93e45b92-9d01-4572-b042-d194e95897f0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.165762 May 27 15:17:29.848717 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 275/563] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:29 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:29.867010 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:29.867676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:29.874669 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.875123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.875894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.876334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.024092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.031925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e6777cab-c65a-4976-8f8d-8bea215cacd5 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1687 microversion: 2.1 time: 0.169798 May 27 15:17:30.032519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 289/564] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:29 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:30.037125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:30.037931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:30.045147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.045592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.046358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.047549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.191561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.195072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:30.200411 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d21b3846-9b4e-41d1-8b48-9ee3c0e3a706 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1553 microversion: 2.1 time: 0.167463 May 27 15:17:30.201012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 276/565] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:30 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:30.865796 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:30.866403 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:30.872885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.873459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.874064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.874493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.009924 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.017180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6df1b7c0-686c-422a-8e0a-c11cff8a167f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.156101 May 27 15:17:31.017734 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 290/566] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:30 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:31.049498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:31.050185 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:31.057782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.058252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.059435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.059890 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.200703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.210037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e0b3ceae-7d21-4312-b5ba-e702fa042987 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1687 microversion: 2.1 time: 0.165272 May 27 15:17:31.210812 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 277/567] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:31 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:31.218575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:31.219493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:31.226629 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.227246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.228296 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.228943 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.513661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.521906 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d3e25833-b2b9-48bc-ba0b-d157d933df4c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1553 microversion: 2.1 time: 0.307924 May 27 15:17:31.540540 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 291/568] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:31 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:31.781290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-e510e5ff-a0be-443e-a3b5-7201acb27cf3 req-794ced3d-20e5-4c5a-a9d5-b37d961a0aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0065699d-fe81-4c03-966a-445d65c3d593", "name": "network-vif-deleted", "tag": "07ab533a-c377-484b-8298-8e84d7500fd8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:31.792347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e510e5ff-a0be-443e-a3b5-7201acb27cf3 req-794ced3d-20e5-4c5a-a9d5-b37d961a0aa6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.792922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-e510e5ff-a0be-443e-a3b5-7201acb27cf3 req-794ced3d-20e5-4c5a-a9d5-b37d961a0aa6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.805481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-e510e5ff-a0be-443e-a3b5-7201acb27cf3 req-794ced3d-20e5-4c5a-a9d5-b37d961a0aa6 service nova] Creating event network-vif-deleted:07ab533a-c377-484b-8298-8e84d7500fd8 for instance 0065699d-fe81-4c03-966a-445d65c3d593 on hv-cinder-84254 May 27 15:17:31.810930 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-e510e5ff-a0be-443e-a3b5-7201acb27cf3 req-794ced3d-20e5-4c5a-a9d5-b37d961a0aa6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 May 27 15:17:31.811627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 278/569] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:32.034524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.035240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.041865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.042322 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.043102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.043542 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.231883 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.232695 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.240072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.240554 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.241342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.241786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.248262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.256553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-957b21fa-edf2-4ba2-81ac-f63f65df31c7 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1367 microversion: 2.1 time: 0.225960 May 27 15:17:32.257249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 292/570] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:32.314514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.323496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-30aae6c6-6838-4646-ac21-e25ec59be22b tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1619 microversion: 2.1 time: 0.099358 May 27 15:17:32.334076 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 279/571] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1619 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:32.377737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ae8cf905-9688-4f84-8b06-ca946b88c8ab req-76283205-d014-47d1-a6f3-a1d962bac691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3e5216-919a-4963-93ed-d2785f1d8a48", "name": "network-vif-deleted", "tag": "37ba6cb7-b917-4678-a64a-21d74c192fb1"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:32.387565 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ae8cf905-9688-4f84-8b06-ca946b88c8ab req-76283205-d014-47d1-a6f3-a1d962bac691 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.387741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ae8cf905-9688-4f84-8b06-ca946b88c8ab req-76283205-d014-47d1-a6f3-a1d962bac691 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.399909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ae8cf905-9688-4f84-8b06-ca946b88c8ab req-76283205-d014-47d1-a6f3-a1d962bac691 service nova] Creating event network-vif-deleted:37ba6cb7-b917-4678-a64a-21d74c192fb1 for instance dc3e5216-919a-4963-93ed-d2785f1d8a48 on hv-cinder-84254 May 27 15:17:32.405163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ae8cf905-9688-4f84-8b06-ca946b88c8ab req-76283205-d014-47d1-a6f3-a1d962bac691 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 May 27 15:17:32.405762 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 293/572] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:32.544633 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.545582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.552845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.553668 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.555701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.556303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.592043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.592913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.593370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lazy-loading 'fault' on Instance uuid 0065699d-fe81-4c03-966a-445d65c3d593 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:32.638707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943b21e6079646dc9f47dd5698278b34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fd239910a6492a953310873fd2379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.646262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ce5639e4-7dd2-4df4-8264-fdcfd9ac424c tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 200 len: 1348 microversion: 2.1 time: 0.105488 May 27 15:17:32.646673 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 280/573] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:33.273334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.274084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.281120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.281570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.282338 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.282776 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.341450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.342969 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.350735 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.351459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.352477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.353064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.390086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.390811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.391470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lazy-loading 'fault' on Instance uuid dc3e5216-919a-4963-93ed-d2785f1d8a48 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:33.442775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:33.452792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-dad08451-810e-4163-b46b-fbbeefd7d88d tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 200 len: 1333 microversion: 2.1 time: 0.114958 May 27 15:17:33.454138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 281/574] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 1333 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:33.491088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:33.498754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-60937376-7f72-4d4f-bf7f-b7c687ad6bc0 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1556 microversion: 2.1 time: 0.229794 May 27 15:17:33.504494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 294/575] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:33.516222 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.516762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.522941 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.523396 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.524163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.524646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.605938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ca19876c-45a1-4984-a0c7-189930b04cb2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093668 May 27 15:17:33.606737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 282/576] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:33.664199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.665166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] [instance: 0065699d-fe81-4c03-966a-445d65c3d593] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.672901 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.673347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.674114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.674721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.689726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] HTTP exception thrown: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Request method failure captured: May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 HTTP/1.1 May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOruNGehysb127FrSoJFliM8FuB_SstpEfhbPVAOX5xbujWuie4omN18-DkMXD-zyLDShx_M-EyjEpctIJcwNc3cKD2xPjOBSiH0kXdGrX-LLR207Rs1uwjfnwopL9i8NOoy1ww-VBfQzABbFqB-bhVXAPCdFznVOBJk6Q9xfKgHoUo May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: b9fd239910a6492a953310873fd2379e May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:17:33.691660 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b9fd239910a6492a953310873fd2379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b9fd239910a6492a953310873fd2379e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b9fd239910a6492a953310873fd2379e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b9fd239910a6492a953310873fd2379e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: b9fd239910a6492a953310873fd2379e May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1626548889 May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-TestMinimumBasicScenario-1626548889-project May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 943b21e6079646dc9f47dd5698278b34 May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestMinimumBasicScenario-1626548889-project May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. May 27 15:17:33.693167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '0065699d-fe81-4c03-966a-445d65c3d593'} May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:33.693988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. May 27 15:17:33.695251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:33.696365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Returning 404 to user: Instance 0065699d-fe81-4c03-966a-445d65c3d593 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:33.696365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1c525583-0ca8-46db-93d7-9a864e7a9a6e tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593" status: 404 len: 111 microversion: 2.1 time: 0.033580 May 27 15:17:33.696365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 295/577] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/0065699d-fe81-4c03-966a-445d65c3d593 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:33.705450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2ca807bc-f48a-4afb-9a22-8aba5d48e6a3 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] Calling method '.version_select at 0x7fa37286a670>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.727052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2ca807bc-f48a-4afb-9a22-8aba5d48e6a3 tempest-TestMinimumBasicScenario-1626548889 tempest-TestMinimumBasicScenario-1626548889-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654495932" status: 202 len: 0 microversion: 2.1 time: 0.028280 May 27 15:17:33.728214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 283/578] 10.222.0.41 () {58 vars in 1268 bytes} [Fri May 27 15:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-654495932 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:34.472668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:34.473338 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: dc3e5216-919a-4963-93ed-d2785f1d8a48] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:34.480166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.480670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.481646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.482093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.496342 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] HTTP exception thrown: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Request method failure captured: May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 HTTP/1.1 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpQpBZVsnDGdmplgtPlCdPQTocc2RyKQ4d1DmoYtpJSdgBDsLpH6sl-lhrkSjw-E_5andgJQY03fKCKoS3_grQxWDdY8VlXgOScqFJveXHANQhMgcEMoFaZvsszy18OseTJXCEc9IAjFe2oi-7k9QujihxLsLHnPiVkgycx8GTQZTg May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:17:34.497902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c162124048a34243867e236c81a70eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c162124048a34243867e236c81a70eb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d25dc63e8a4c4af8af2fe29b7819212b May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. May 27 15:17:34.499475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'dc3e5216-919a-4963-93ed-d2785f1d8a48'} May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:34.500221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. May 27 15:17:34.501778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:34.504195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Returning 404 to user: Instance dc3e5216-919a-4963-93ed-d2785f1d8a48 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:34.505082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9c96f9d0-438f-4c8a-b8bf-2697a5b2c6f6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48" status: 404 len: 111 microversion: 2.1 time: 0.037982 May 27 15:17:34.508685 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 296/579] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:34 2022] GET /compute/v2.1/servers/dc3e5216-919a-4963-93ed-d2785f1d8a48 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:34.514885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5593b16a-9c4e-47ed-a473-262e49e505d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '.version_select at 0x7fa3726a7a60>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:34.536045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5593b16a-9c4e-47ed-a473-262e49e505d1 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-21880966" status: 202 len: 0 microversion: 2.1 time: 0.024542 May 27 15:17:34.536986 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 284/580] 10.222.0.41 () {58 vars in 1214 bytes} [Fri May 27 15:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-21880966 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:35.050953 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-dcce14d0-d0ba-40df-ad8f-d46bc9933b88 req-4d194be9-b321-445a-8023-2514e6629b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044df8fd-2d18-4cca-bfa1-a9f4febd691d", "tag": "539036bd-12f7-44c7-adfe-551cea6b99a2"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:35.059404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-dcce14d0-d0ba-40df-ad8f-d46bc9933b88 req-4d194be9-b321-445a-8023-2514e6629b3d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.060163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-dcce14d0-d0ba-40df-ad8f-d46bc9933b88 req-4d194be9-b321-445a-8023-2514e6629b3d service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.072974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-dcce14d0-d0ba-40df-ad8f-d46bc9933b88 req-4d194be9-b321-445a-8023-2514e6629b3d service nova] Creating event network-changed:539036bd-12f7-44c7-adfe-551cea6b99a2 for instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d on hv-cinder-84254 May 27 15:17:35.078570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-dcce14d0-d0ba-40df-ad8f-d46bc9933b88 req-4d194be9-b321-445a-8023-2514e6629b3d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031867 May 27 15:17:35.079771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 297/581] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:37.726025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.726611 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.735755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.736766 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.738177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.739141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.778623 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:37.879903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b31d1513-e73a-4382-9b29-06980321cd57 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 204 len: 0 microversion: 2.1 time: 0.157938 May 27 15:17:37.894647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.895511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.896582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 285/582] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:17:37 2022] DELETE /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:17:37.903151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.903787 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.904725 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.905243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.152438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.160586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-28e61f87-b92e-4dd9-8b8b-8bcc02c4d668 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1508 microversion: 2.1 time: 0.274252 May 27 15:17:38.161156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 298/583] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:39.180568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.181178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:39.188607 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.189069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.189913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.191401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.356965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.366903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-59f4fc6d-f8bb-419f-ae89-4961404201b8 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1508 microversion: 2.1 time: 0.192165 May 27 15:17:39.376868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 286/584] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:39 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:40.384021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:40.384696 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:40.398018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.398986 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.400173 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.400911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.637489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.645876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d959d7c9-4439-49ea-a8c6-00357062a272 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 200 len: 1508 microversion: 2.1 time: 0.265551 May 27 15:17:40.646356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 299/585] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:40 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:40.900211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-4b5437f6-cab6-48c2-842c-6db75e813603 req-6238bdbf-f33c-4d10-a80e-5e14c996fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fbebd8-749c-4afa-901d-cb88ccb3682a", "name": "network-vif-deleted", "tag": "f267f173-ac83-4368-b018-5052c6c6d82d"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:40.909689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4b5437f6-cab6-48c2-842c-6db75e813603 req-6238bdbf-f33c-4d10-a80e-5e14c996fd77 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.910594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-4b5437f6-cab6-48c2-842c-6db75e813603 req-6238bdbf-f33c-4d10-a80e-5e14c996fd77 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.926003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-4b5437f6-cab6-48c2-842c-6db75e813603 req-6238bdbf-f33c-4d10-a80e-5e14c996fd77 service nova] Creating event network-vif-deleted:f267f173-ac83-4368-b018-5052c6c6d82d for instance d4fbebd8-749c-4afa-901d-cb88ccb3682a on hv-cinder-84254 May 27 15:17:40.932366 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-4b5437f6-cab6-48c2-842c-6db75e813603 req-6238bdbf-f33c-4d10-a80e-5e14c996fd77 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125891 May 27 15:17:40.936662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 287/586] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:41.664073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:41.664795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: d4fbebd8-749c-4afa-901d-cb88ccb3682a] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.681962 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.684575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.687189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.687189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.733723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] HTTP exception thrown: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Request method failure captured: May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a HTTP/1.1 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpQpBZVsnDGdmplgtPlCdPQTocc2RyKQ4d1DmoYtpJSdgBDsLpH6sl-lhrkSjw-E_5andgJQY03fKCKoS3_grQxWDdY8VlXgOScqFJveXHANQhMgcEMoFaZvsszy18OseTJXCEc9IAjFe2oi-7k9QujihxLsLHnPiVkgycx8GTQZTg May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:17:41.735616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c162124048a34243867e236c81a70eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c162124048a34243867e236c81a70eb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d25dc63e8a4c4af8af2fe29b7819212b May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. May 27 15:17:41.736972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'd4fbebd8-749c-4afa-901d-cb88ccb3682a'} May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:41.738711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. May 27 15:17:41.740377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:41.741523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Returning 404 to user: Instance d4fbebd8-749c-4afa-901d-cb88ccb3682a could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:41.741523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9676af6e-f14f-4974-b091-3d4588a4a791 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a" status: 404 len: 111 microversion: 2.1 time: 0.078572 May 27 15:17:41.741523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 300/587] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:41 2022] GET /compute/v2.1/servers/d4fbebd8-749c-4afa-901d-cb88ccb3682a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:41.748096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:41.748769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.763313 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.764006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.766441 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.767490 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.795137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:41.884955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4e41d2e4-0869-44f1-81e2-d49308ae61dd tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 204 len: 0 microversion: 2.1 time: 0.140924 May 27 15:17:41.885606 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 288/588] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:17:41 2022] DELETE /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:41.894300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:41.895336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.901621 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.902272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.903031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.903625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.042615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.049942 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1442dcf2-3b9e-4cb4-b5f9-fe33f6baf0e6 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.160067 May 27 15:17:42.050495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 301/589] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:41 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:43.068230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:43.068952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:43.075387 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.075834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.076693 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.077135 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.209662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.217170 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-04b2f953-fb90-4f58-8cc9-ba5c7103ac88 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.154084 May 27 15:17:43.217994 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 289/590] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:43 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:44.235159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.235761 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.245846 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.246527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.247590 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.248082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.704575 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25dc63e8a4c4af8af2fe29b7819212b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162124048a34243867e236c81a70eb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.712887 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a7c7fe03-4eb0-4ae4-9731-0aca10462d13 tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 200 len: 1520 microversion: 2.1 time: 0.482432 May 27 15:17:44.713452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 302/591] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:45.053894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-7ece64a7-f812-42dc-a1e1-80b6c087bca8 req-5c15d62b-85eb-4b98-a858-6a2f6f497f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e89d631-1962-4ed9-a49a-96fe0948d096", "name": "network-vif-deleted", "tag": "50dd4811-1b47-422c-9bcd-2b24d3055609"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:45.063056 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7ece64a7-f812-42dc-a1e1-80b6c087bca8 req-5c15d62b-85eb-4b98-a858-6a2f6f497f07 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.063516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7ece64a7-f812-42dc-a1e1-80b6c087bca8 req-5c15d62b-85eb-4b98-a858-6a2f6f497f07 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.074651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-7ece64a7-f812-42dc-a1e1-80b6c087bca8 req-5c15d62b-85eb-4b98-a858-6a2f6f497f07 service nova] Creating event network-vif-deleted:50dd4811-1b47-422c-9bcd-2b24d3055609 for instance 4e89d631-1962-4ed9-a49a-96fe0948d096 on hv-cinder-84254 May 27 15:17:45.080015 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-7ece64a7-f812-42dc-a1e1-80b6c087bca8 req-5c15d62b-85eb-4b98-a858-6a2f6f497f07 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029853 May 27 15:17:45.080655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 290/592] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:45.730877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.731398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] [instance: 4e89d631-1962-4ed9-a49a-96fe0948d096] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.738262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.738719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.739542 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.739984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.753186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] HTTP exception thrown: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Request method failure captured: May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 HTTP/1.1 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpQpBZVsnDGdmplgtPlCdPQTocc2RyKQ4d1DmoYtpJSdgBDsLpH6sl-lhrkSjw-E_5andgJQY03fKCKoS3_grQxWDdY8VlXgOScqFJveXHANQhMgcEMoFaZvsszy18OseTJXCEc9IAjFe2oi-7k9QujihxLsLHnPiVkgycx8GTQZTg May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:17:45.754699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c162124048a34243867e236c81a70eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c162124048a34243867e236c81a70eb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c162124048a34243867e236c81a70eb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: c162124048a34243867e236c81a70eb0 May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-456930567 May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: d25dc63e8a4c4af8af2fe29b7819212b May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-456930567-project May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. May 27 15:17:45.756212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '4e89d631-1962-4ed9-a49a-96fe0948d096'} May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:45.757045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. May 27 15:17:45.758243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:17:45.759264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] Returning 404 to user: Instance 4e89d631-1962-4ed9-a49a-96fe0948d096 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:45.759264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-40728726-2b75-4b56-8022-72d3b2693fad tempest-ServerRescueNegativeTestJSON-456930567 tempest-ServerRescueNegativeTestJSON-456930567-project] 10.222.0.41 "GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096" status: 404 len: 111 microversion: 2.1 time: 0.029340 May 27 15:17:45.759264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 303/593] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/4e89d631-1962-4ed9-a49a-96fe0948d096 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:17:54.189407 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-514b390e-38a3-4952-b3c5-e76cea4dfed1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: .version_select at 0x7fa3726badc0>, body: {"keypair": {"name": "tempest-keypair-1167098453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzbN54QAZ0EPnY73XnR85acB+tMByTaNnDzndfRimqCqIeVHkYKE33YT183ZAVW20bYH8DNJaef1qeSFgKqEtlLz/7qzdohx3mzk3ecMFpVefLASYlOACwrMvnXumGj0w=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:54.203823 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-514b390e-38a3-4952-b3c5-e76cea4dfed1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:54.208152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-514b390e-38a3-4952-b3c5-e76cea4dfed1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for user 973c068eff44436785ddf19a6465da8f and project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:54.232044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-514b390e-38a3-4952-b3c5-e76cea4dfed1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.167979 May 27 15:17:54.232685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 291/594] 10.222.0.41 () {62 vars in 1199 bytes} [Fri May 27 15:17:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:17:55.141255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:55.142900 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:55.151029 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:55.157758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.158399 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.159476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.160213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.189241 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-25c20dc6-c7e5-4c6a-85c9-fc5385412cd0 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/ips" status: 200 len: 145 microversion: 2.1 time: 0.058632 May 27 15:17:55.190620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 304/595] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:17:55 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/ips => generated 145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:55.858107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:55.863098 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-532810225", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bae1b8f-6527-43a2-8c28-4f4a1470a167"}], "security_groups": [{"name": "tempest-securitygroup--1404423576"}], "key_name": "tempest-keypair-1167098453", "user_data": "}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:55.970762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] validate_networks() for [('7bae1b8f-6527-43a2-8c28-4f4a1470a167', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:56.411912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:56.412339 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:56.412953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:56.413831 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:56.414471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:56.426041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.426800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.427850 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.428517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.450645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:56.455092 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for user 973c068eff44436785ddf19a6465da8f and project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:56.467731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:56.470189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:56.526161 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ef533378-ea96-437c-943f-48e72c9dca16 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.669197 May 27 15:17:56.526722 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 292/596] 10.222.0.41 () {62 vars in 1187 bytes} [Fri May 27 15:17:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:17:56.537518 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:56.538126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:56.601346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.610073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.611902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.614288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ed1b61a-ac93-496f-a964-390d5962e292 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1281 microversion: 2.20 time: 0.081582 May 27 15:17:56.615687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 305/597] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:17:56 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:56.621014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2496386a-3133-4d2b-a343-bb0666d3ddac"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:56.622203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:56.630828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.631282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.632046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.632509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.927165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f1c920de-f5de-4cbb-b8ed-005cc0dbaf05 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310069 May 27 15:17:56.928477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 293/598] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:17:56 2022] POST /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:57.640136 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.641455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:57.651200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.651886 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.652717 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.653163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.756795 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.774070 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.777295 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.779213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-127490d0-efe6-4e2b-9273-c7a2aec8805d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1341 microversion: 2.20 time: 0.150762 May 27 15:17:57.779858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 306/599] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:17:57 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:58.800299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:58.801562 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:58.803529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:58.809057 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.809516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.810294 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.810738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:59.302342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.313099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.314632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.316026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-65680ed0-540f-469e-9499-9e283f0ec497 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.520907 May 27 15:17:59.321371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 294/600] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:17:58 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:59.458150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-ec1679b5-e8ef-485f-8db5-7cc4bc01a50c req-0c275c2a-9df9-49e2-9921-8f587d0f9774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:59.480766 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ec1679b5-e8ef-485f-8db5-7cc4bc01a50c req-0c275c2a-9df9-49e2-9921-8f587d0f9774 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:59.481647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-ec1679b5-e8ef-485f-8db5-7cc4bc01a50c req-0c275c2a-9df9-49e2-9921-8f587d0f9774 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:59.487610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=89 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:59.497574 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-ec1679b5-e8ef-485f-8db5-7cc4bc01a50c req-0c275c2a-9df9-49e2-9921-8f587d0f9774 service nova] Creating event network-changed:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:17:59.504527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-ec1679b5-e8ef-485f-8db5-7cc4bc01a50c req-0c275c2a-9df9-49e2-9921-8f587d0f9774 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053925 May 27 15:17:59.505947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 307/601] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:00.334351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:00.334992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:00.341458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.341911 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.342931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.343368 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.477314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.485361 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.486956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.488143 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f80b7990-35d9-406b-aad9-25725acbe083 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.157791 May 27 15:18:00.488734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 295/602] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:00 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:01.507480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.508092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.518941 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.519084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.520349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.521082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.653794 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.662407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.663924 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.665061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-57d54823-778d-491b-afae-b0f790c9dcd6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.162820 May 27 15:18:01.665617 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 308/603] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:01 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:02.683132 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.683744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.690929 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.691388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.692163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.692635 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.821517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.829513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.831150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.832219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1451e1e4-db89-45a6-b79e-62281569d198 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.153032 May 27 15:18:02.832818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 296/604] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:03.850059 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:03.850667 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:03.857147 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.857597 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.858356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.858794 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.992861 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.000667 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.002169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.003266 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-75d35bb4-5d97-45c4-b4bf-8b6da5112d75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.157806 May 27 15:18:04.003815 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 309/605] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:03 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:04.352252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-9e86d667-6515-4e3c-abf3-73ad5eed64bc req-dd0b7057-c4e3-485f-8097-5db0e37cbc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "name": "network-vif-plugged", "status": "completed", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:04.361718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-9e86d667-6515-4e3c-abf3-73ad5eed64bc req-dd0b7057-c4e3-485f-8097-5db0e37cbc73 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.362255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-9e86d667-6515-4e3c-abf3-73ad5eed64bc req-dd0b7057-c4e3-485f-8097-5db0e37cbc73 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.373558 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-9e86d667-6515-4e3c-abf3-73ad5eed64bc req-dd0b7057-c4e3-485f-8097-5db0e37cbc73 service nova] Creating event network-vif-plugged:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:18:04.378776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-9e86d667-6515-4e3c-abf3-73ad5eed64bc req-dd0b7057-c4e3-485f-8097-5db0e37cbc73 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090462 May 27 15:18:04.379548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 297/606] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:04.505190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.506121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.512060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.512547 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.513313 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.513748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.544974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-94057642-37b7-4902-8197-1e4e7cc9a65f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 May 27 15:18:04.545643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 310/607] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:04.556953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.557732 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.564129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.564625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.566259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.566798 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.598309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f51410f2-b7a3-4112-8e53-641a5ddd26f6 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac" status: 200 len: 194 microversion: 2.1 time: 0.045745 May 27 15:18:04.598907 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 298/608] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:05.021204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:05.021817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:05.028224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.028707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.029477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.029914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.166435 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.174549 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.176139 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.177276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ffa0663d-a717-41c7-ace9-4da6e99c940a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1407 microversion: 2.20 time: 0.160733 May 27 15:18:05.177838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 311/609] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:05 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:05.917368 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa10c4df-0d89-4c49-8ead-c39a54acd2ea"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:05.918489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:05.925718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.926174 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.926940 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.927382 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.196072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.196808 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.203395 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.204200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.205158 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.205739 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.261802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-65a17824-d3d1-48a4-9b6a-98e6c15ad26b tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "POST /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348265 May 27 15:18:06.262412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 299/610] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:18:05 2022] POST /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:06.355320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.364032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.365587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.366746 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1c09ed36-6f48-4aff-804d-c5394567aea8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1597 microversion: 2.20 time: 0.175062 May 27 15:18:06.367304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 312/611] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:06.386244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.386862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.393826 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.394281 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.395059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.395499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.437268 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:06.462967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=10 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:06.474216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-09b85287-b64c-4abc-a858-e487e8ce4a8c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093030 May 27 15:18:06.474810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 300/612] 10.222.0.41 () {60 vars in 1315 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:18:07.413853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-59df4d2d-3684-4eaa-b140-9ed45f142155 req-0f1841e3-f192-419d-bdd3-bf5c2092d322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:07.417371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:07.425129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-59df4d2d-3684-4eaa-b140-9ed45f142155 req-0f1841e3-f192-419d-bdd3-bf5c2092d322 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.425715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-59df4d2d-3684-4eaa-b140-9ed45f142155 req-0f1841e3-f192-419d-bdd3-bf5c2092d322 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.436684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-59df4d2d-3684-4eaa-b140-9ed45f142155 req-0f1841e3-f192-419d-bdd3-bf5c2092d322 service nova] Creating event network-changed:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:18:07.442408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-59df4d2d-3684-4eaa-b140-9ed45f142155 req-0f1841e3-f192-419d-bdd3-bf5c2092d322 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032179 May 27 15:18:07.442995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 313/613] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:10.955155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:10.956347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:10.962273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.962731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.963494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.963937 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.988771 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1b928cbb-f513-4186-8c28-912ad6e40a3a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/ips" status: 200 len: 149 microversion: 2.1 time: 0.038025 May 27 15:18:10.989329 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 301/614] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:18:10 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:12.302027 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf007b6a-9620-4ee8-858d-97d9b747e1b5"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:12.303151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:12.309333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.309782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.310527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.310956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.968406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ae1d386-c40b-476d-bc5b-779b3824bcdc tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "POST /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670990 May 27 15:18:12.969043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 314/615] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:18:12 2022] POST /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:13.766767 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.767760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.774827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.775287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.776054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.776520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.804932 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5545c4ce-3c64-41af-ae6b-7d0c0c6048cd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042754 May 27 15:18:13.805469 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 302/616] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:13.947525 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.948104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.954451 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.954899 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.956258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.956805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.984630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-375dcfd1-5a7e-42dd-845b-d49785c5de57 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac" status: 200 len: 194 microversion: 2.1 time: 0.041824 May 27 15:18:13.985119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 315/617] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:13.995352 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.995848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:14.001890 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.003063 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.003846 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.004286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.085598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lazy-loading 'services' on Instance uuid fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:14.156133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f6364abf-a46f-486e-b1df-2368fd0f61a2 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac" status: 202 len: 0 microversion: 2.1 time: 0.164520 May 27 15:18:14.156765 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 303/618] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:18:13 2022] DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/2496386a-3133-4d2b-a343-bb0666d3ddac => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:16.303903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:16.304433 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:16.311017 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.311472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.312269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.312731 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.335825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lazy-loading 'flavor' on Instance uuid 131f6f40-b40d-48f7-a293-45934ec4bfbe {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:16.408109 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4fea2dc2-f346-433d-8e4a-dd18657433a8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "POST /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe/action" status: 202 len: 0 microversion: 2.1 time: 0.108147 May 27 15:18:16.409780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 316/619] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:18:16 2022] POST /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:16.418841 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:16.419537 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:16.426411 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.426863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.427636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.428082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.568409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:16.575912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6553a93b-6d01-47b8-b1c8-d4057559bcf9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.161868 May 27 15:18:16.576675 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 304/620] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:16 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:17.595901 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:17.596670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:17.602862 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.603314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.604087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.604555 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.735265 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:17.744007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-89ba6a38-b686-448d-ae28-8cae4b6d5771 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.153142 May 27 15:18:17.744595 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 317/621] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:17 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:18.762200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.763310 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.775419 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.776262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.777711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.778523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.914738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:18.922412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-491c58a5-f114-41b0-be76-4b00de035349 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.164215 May 27 15:18:18.923011 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 305/622] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:19.503137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:19.503842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:19.510188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.510646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.511413 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.511854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.594139 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lazy-loading 'services' on Instance uuid 044df8fd-2d18-4cca-bfa1-a9f4febd691d {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:19.665648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-398e540d-6878-417b-b736-4e74719b3868 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments/cf007b6a-9620-4ee8-858d-97d9b747e1b5" status: 202 len: 0 microversion: 2.1 time: 0.166839 May 27 15:18:19.666233 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 318/623] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:18:19 2022] DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments/cf007b6a-9620-4ee8-858d-97d9b747e1b5 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:19.675304 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:19.676390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:19.682556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.683014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.683832 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.684278 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.712889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f6b094e1-96df-45c7-a974-7c1a184f8b76 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 May 27 15:18:19.713363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 306/624] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:19 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:19.941345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:19.942150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:19.950153 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.950616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.951397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.951843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.093609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:20.101677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c02e1f45-c928-4371-aef2-79ef6014a3e0 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.166146 May 27 15:18:20.102226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 319/625] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:19 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:20.554273 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.554849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.561430 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.561898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.562655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.563093 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.567670 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:20.593482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b064c665-1f47-4c43-92de-d5a1245c3278 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/fa10c4df-0d89-4c49-8ead-c39a54acd2ea" status: 200 len: 194 microversion: 2.1 time: 0.043899 May 27 15:18:20.594072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 307/626] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/fa10c4df-0d89-4c49-8ead-c39a54acd2ea => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:20.604421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.604940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.611461 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.612549 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.613253 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.613705 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.694433 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lazy-loading 'services' on Instance uuid fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:20.697837 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:20.727580 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.729450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.736263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.737182 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.738408 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.739039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.773943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-eb6ab523-fe85-42e5-9a7e-b4f8565a6cef tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052957 May 27 15:18:20.774256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dcb69ab7-8167-4f63-8cb2-a3eb54e35bbd tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/fa10c4df-0d89-4c49-8ead-c39a54acd2ea" status: 202 len: 0 microversion: 2.1 time: 0.173465 May 27 15:18:20.774869 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 308/627] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:20.775025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 320/628] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:18:20 2022] DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments/fa10c4df-0d89-4c49-8ead-c39a54acd2ea => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:21.118991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.119603 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.125623 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.126072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.126834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.127970 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.260375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.268108 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-97bddce1-708f-48e8-bd4d-b1e62d2a957d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.152860 May 27 15:18:21.269395 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 309/629] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:21.788093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.789137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.795390 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.795843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.796642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.797104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.825746 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dcb1bdd6-771a-470f-96d3-ba45b80387ec tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043382 May 27 15:18:21.826288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 321/630] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:18:21.885639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.886146 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.892663 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.893755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.894530 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.894974 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.922065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:21.963984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.964961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.971843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.972293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.973074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.973502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.999418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-305e65b2-df2f-43e6-8268-3a6e7adbec06 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 204 len: 0 microversion: 2.1 time: 0.117485 May 27 15:18:22.000001 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 310/631] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:21 2022] DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:22.005248 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb522895-bb1e-43fc-8685-825837b23ba5 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045235 May 27 15:18:22.005815 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 322/632] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:18:22.009201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.010669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.017113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.017638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.018521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.018991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.117196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.118106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.124237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.124723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.125521 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.126003 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.154894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.155311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c4383d64-4e7e-4f04-a0ef-8250cafe4d18 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042084 May 27 15:18:22.155867 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 323/633] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:18:22.163296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0e938593-a19b-4ca5-b424-5fe288a71c6f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1681 microversion: 2.1 time: 0.158383 May 27 15:18:22.163866 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 311/634] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:22.213961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.214456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.221601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.222057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.222850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.223287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.247903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:22.285687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.286403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.293218 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.293638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.294428 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.294860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.323334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f1cc726f-c540-4785-893a-d0b45a59f347 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 204 len: 0 microversion: 2.1 time: 0.112969 May 27 15:18:22.324142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 324/635] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:22 2022] DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:22.333269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.333966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.339989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.340438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.341294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.341801 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.474739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.482376 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f0ec6ec3-d39e-428a-8393-e4fbc870c27a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.201250 May 27 15:18:22.482948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 312/636] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:22.507281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.514675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8380696-0c3d-4b6b-9697-46ca2372236c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1673 microversion: 2.1 time: 0.186194 May 27 15:18:22.515230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 325/637] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:23.180657 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.181322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.188086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.188628 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.189436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.190525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.321572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.329280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6f25eaa0-0a8f-47ff-afea-3b78647f1817 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1681 microversion: 2.1 time: 0.152753 May 27 15:18:23.330237 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 313/638] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:23.499093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.499668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.506388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.506842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.507609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.508060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.532472 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.533105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.541351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.541801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.542626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.543068 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.698221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.706876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b57e69bc-b226-48c3-bf15-129ebd25f9d5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.211890 May 27 15:18:23.707851 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 326/639] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:23.722855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.730227 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-daa0d373-ef87-41c3-aea9-86856f71985c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1673 microversion: 2.1 time: 0.201569 May 27 15:18:23.730781 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 314/640] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:24.346899 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.347563 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.353648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.354129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.354894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.355333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.483125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.491410 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-90749f4c-b431-49c4-9bf2-6c5ee5086df3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1681 microversion: 2.1 time: 0.148745 May 27 15:18:24.491973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 327/641] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:24.724240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.724836 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.731314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.731770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.732563 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.733002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.747972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.748612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.755153 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.755608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.756377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.756843 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.932141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.939721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b72630fa-c20c-4729-9b92-9b057da0b455 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.220131 May 27 15:18:24.941047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 315/642] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:24.942490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.950042 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc35db27-6820-446a-8725-1b878e588cf4 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1673 microversion: 2.1 time: 0.206248 May 27 15:18:24.950587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 328/643] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:25.509031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.509936 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.516141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.516781 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.517738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.518188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.753670 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:25.761776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7e0553b3-bda7-4c3b-94a5-e083ddb4f7f2 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1681 microversion: 2.1 time: 0.257326 May 27 15:18:25.769658 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 316/644] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:25.958165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.958775 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.962849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:25.970152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.970535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.971928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.972514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.973945 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.974832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.979530 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.980291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.982774 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.982964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.115266 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097084a3e57540d18bae448da3b3ecc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d5173b32b5480790babb3d178b94fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.124270 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b90e93ba-dcf5-4de2-bb28-03481cc349d7 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 200 len: 1606 microversion: 2.1 time: 0.160990 May 27 15:18:26.124874 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 317/645] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:26.144945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-7e07a644-e191-46cd-83f1-f74d3bd5ac99 req-033e1a52-e852-4555-92a5-fd466a9e0eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6a2750-8fc3-4343-9fb3-aa9177dd01a7", "name": "network-vif-deleted", "tag": "8ce3e0a8-1883-4f25-97d5-3b1fd586b141"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:26.160888 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7e07a644-e191-46cd-83f1-f74d3bd5ac99 req-033e1a52-e852-4555-92a5-fd466a9e0eda service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.163711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7e07a644-e191-46cd-83f1-f74d3bd5ac99 req-033e1a52-e852-4555-92a5-fd466a9e0eda service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.183230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-7e07a644-e191-46cd-83f1-f74d3bd5ac99 req-033e1a52-e852-4555-92a5-fd466a9e0eda service nova] Creating event network-vif-deleted:8ce3e0a8-1883-4f25-97d5-3b1fd586b141 for instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 on hv-cinder-84254 May 27 15:18:26.200890 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-7e07a644-e191-46cd-83f1-f74d3bd5ac99 req-033e1a52-e852-4555-92a5-fd466a9e0eda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060473 May 27 15:18:26.205943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 318/646] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:26.402782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.412105 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7d9a240c-0cb1-4688-b1c2-e37929751ec1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.458999 May 27 15:18:26.415356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 329/647] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:26.682344 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-59d5111f-bc92-4be0-a8fa-92599898afad req-465bb98d-ecf5-48a3-98a1-eba74ad7ffd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044df8fd-2d18-4cca-bfa1-a9f4febd691d", "name": "network-vif-deleted", "tag": "539036bd-12f7-44c7-adfe-551cea6b99a2"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:26.691719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-59d5111f-bc92-4be0-a8fa-92599898afad req-465bb98d-ecf5-48a3-98a1-eba74ad7ffd6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.692068 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-59d5111f-bc92-4be0-a8fa-92599898afad req-465bb98d-ecf5-48a3-98a1-eba74ad7ffd6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.705739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-59d5111f-bc92-4be0-a8fa-92599898afad req-465bb98d-ecf5-48a3-98a1-eba74ad7ffd6 service nova] Creating event network-vif-deleted:539036bd-12f7-44c7-adfe-551cea6b99a2 for instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d on hv-cinder-84254 May 27 15:18:26.711595 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-59d5111f-bc92-4be0-a8fa-92599898afad req-465bb98d-ecf5-48a3-98a1-eba74ad7ffd6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033109 May 27 15:18:26.716990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 319/648] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:26.779449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.780152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:26.792335 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.793646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.796537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.797441 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.949916 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced10e76e5cc4443819157c821f82226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1a70bd2ce64fbcb738a2cfcfb09f41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.962329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b8cd7eb-5f76-45c6-ba21-7bb8a403b08b tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 200 len: 1326 microversion: 2.1 time: 0.184826 May 27 15:18:26.973202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 330/649] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:26 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 1326 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:27.142242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.143693 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.150782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.151402 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.152379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.153019 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.168214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 HTTP/1.1 May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:27.170169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:27.171887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'fd6a2750-8fc3-4343-9fb3-aa9177dd01a7'} May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:27.172703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:27.175205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:27.176507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:27.176507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-263874bf-3ebe-4d7b-8e16-e9458ffb2ea1 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 404 len: 111 microversion: 2.1 time: 0.034537 May 27 15:18:27.178946 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 320/650] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:27.183798 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0007e052-ecf3-41f1-8a18-5a56bbb0777c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '.version_select at 0x7fa3720ec310>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.207385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0007e052-ecf3-41f1-8a18-5a56bbb0777c tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489358213" status: 202 len: 0 microversion: 2.1 time: 0.027450 May 27 15:18:27.209000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 331/651] 10.222.0.41 () {58 vars in 1220 bytes} [Fri May 27 15:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489358213 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:18:27.432376 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.433027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.448023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.448512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.449295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.449736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.744347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.753668 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5351173c-642c-49a7-bd1f-6220a9711301 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.325694 May 27 15:18:27.755105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 321/652] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:27.979637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.980290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.988187 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.988824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.989668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.990108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.005188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d HTTP/1.1 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:28.007169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:28.008567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '044df8fd-2d18-4cca-bfa1-a9f4febd691d'} May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:28.009397 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:28.010654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:28.011803 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:28.011803 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e77ee513-c07c-4b0c-abf8-c8982d71114d tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 404 len: 111 microversion: 2.1 time: 0.033024 May 27 15:18:28.017333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-34aecc50-19d2-4b6a-9227-a9a18881317f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '.version_select at 0x7fa3726a74c0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.021199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 332/653] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:28.037106 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-34aecc50-19d2-4b6a-9227-a9a18881317f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575703615" status: 202 len: 0 microversion: 2.1 time: 0.023470 May 27 15:18:28.038010 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 322/654] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 15:18:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575703615 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:28.773071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.773722 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.780261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.780747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.781561 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.781999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.916535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:28.924279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-83d659ec-da5c-4954-8027-6a7aa14942fb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.155238 May 27 15:18:28.924973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 333/655] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:29.800710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.801240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.803124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:29.808507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.808975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.809755 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.810201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.825778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d HTTP/1.1 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:29.827912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.829565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '044df8fd-2d18-4cca-bfa1-a9f4febd691d'} May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:29.831343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.833389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:29.834818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:29.834818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5a00fa8b-a7de-48da-9882-890021abf01a tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 404 len: 111 microversion: 2.1 time: 0.033139 May 27 15:18:29.834818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 323/656] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:29 2022] DELETE /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:29.838356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.838970 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: 044df8fd-2d18-4cca-bfa1-a9f4febd691d] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.845724 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.846752 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.847520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.847974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.861717 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d HTTP/1.1 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:29.863249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.864831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '044df8fd-2d18-4cca-bfa1-a9f4febd691d'} May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:29.865639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. May 27 15:18:29.867172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:29.868482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance 044df8fd-2d18-4cca-bfa1-a9f4febd691d could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:29.868482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1ba2af6-9371-435a-9f42-56b4e864dc3c tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d" status: 404 len: 111 microversion: 2.1 time: 0.030216 May 27 15:18:29.868482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 334/657] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:29 2022] GET /compute/v2.1/servers/044df8fd-2d18-4cca-bfa1-a9f4febd691d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:29.942786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.943412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.949816 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.950249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.951147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.951697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.091905 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.100528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cee71ea3-4446-49c7-b22d-7ed0c3906da3 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1570 microversion: 2.1 time: 0.162349 May 27 15:18:30.101084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 324/658] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:29 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:30.118126 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:30.118770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.125366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.125940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.126636 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.127075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.272308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e79dd0c8-946c-4a29-9d67-ace7e49a9af9 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "POST /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe/action" status: 202 len: 0 microversion: 2.1 time: 0.158242 May 27 15:18:30.272937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 335/659] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 15:18:30 2022] POST /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:30.281110 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.281808 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.298249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.302256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.302256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.302256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.316198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.316909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.325273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.325912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.326684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.327117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.342439 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 HTTP/1.1 May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:30.344256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.346657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'fd6a2750-8fc3-4343-9fb3-aa9177dd01a7'} May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:30.349356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.350832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.352328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:30.352328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c7dd7c2c-cca9-4aab-8b50-2858f0f78c9d tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 404 len: 111 microversion: 2.1 time: 0.033992 May 27 15:18:30.352328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 336/660] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:30 2022] DELETE /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:30.358866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.359476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: fd6a2750-8fc3-4343-9fb3-aa9177dd01a7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.367815 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.367815 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.368745 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.369181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.387035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 HTTP/1.1 May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:30.387974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.389524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'fd6a2750-8fc3-4343-9fb3-aa9177dd01a7'} May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:30.390440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. May 27 15:18:30.392909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:30.394054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:30.394054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c15147dd-8e5b-462f-b991-fe21cc13086f tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7" status: 404 len: 111 microversion: 2.1 time: 0.035851 May 27 15:18:30.394054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 337/661] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/fd6a2750-8fc3-4343-9fb3-aa9177dd01a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:30.504698 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.512763 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:30.525608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-35a14762-5bcf-43fd-8b60-ea8a758d2d20 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1518 microversion: 2.1 time: 0.248420 May 27 15:18:30.526493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 325/662] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:31.006707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.007232 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.014053 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.014506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.015272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.015761 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.018780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:31.031777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be HTTP/1.1 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:31.034341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.035944 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'bf6cd350-0623-438f-9e66-2e086037c8be'} May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.037108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.038514 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.039907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.039907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6683a274-9940-458d-aa6b-8c68d885a4d4 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 404 len: 111 microversion: 2.1 time: 0.033091 May 27 15:18:31.039907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 338/663] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:31 2022] DELETE /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:31.044865 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.045520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: bf6cd350-0623-438f-9e66-2e086037c8be] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.054912 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.055594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.056481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.057030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.074172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be HTTP/1.1 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:31.075728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.079149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'bf6cd350-0623-438f-9e66-2e086037c8be'} May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.080125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. May 27 15:18:31.082733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.084046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance bf6cd350-0623-438f-9e66-2e086037c8be could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.084046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1a5a88b3-da11-41d0-9b15-b2ca5aac381f tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be" status: 404 len: 111 microversion: 2.1 time: 0.036375 May 27 15:18:31.084046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 326/664] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/bf6cd350-0623-438f-9e66-2e086037c8be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:31.086819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.087320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.093792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.094244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.095018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.095465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.113475 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 HTTP/1.1 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:31.115969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.117612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'fc6ebf9a-c645-4e5f-a78c-99539adcdf08'} May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.118405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.119952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:31.121336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.121336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b3992e4-baf6-449c-88b6-8baecb27c693 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 404 len: 111 microversion: 2.1 time: 0.035076 May 27 15:18:31.121336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 339/665] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:31 2022] DELETE /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:31.127586 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.128655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: fc6ebf9a-c645-4e5f-a78c-99539adcdf08] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.136967 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.137420 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.138219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.138751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.155467 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 HTTP/1.1 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:31.157206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.159245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'fc6ebf9a-c645-4e5f-a78c-99539adcdf08'} May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.160130 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. May 27 15:18:31.161619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.163426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance fc6ebf9a-c645-4e5f-a78c-99539adcdf08 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.163763 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5e19b205-64e6-4d94-80ea-14983fb029a6 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08" status: 404 len: 111 microversion: 2.1 time: 0.037074 May 27 15:18:31.164401 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 327/666] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/fc6ebf9a-c645-4e5f-a78c-99539adcdf08 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:31.546777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.546777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.551443 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.551984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.553213 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.553355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.553745 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.553923 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.559661 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.560109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.560977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.561413 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.576390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef HTTP/1.1 May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:31.578740 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.580384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '90285ea2-a28f-4844-9a8a-652ecafc72ef'} May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.581433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.582910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.584375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.584375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7775f9b8-c9b6-4b7d-a48f-0fdefe7e3833 tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 404 len: 111 microversion: 2.1 time: 0.032319 May 27 15:18:31.584375 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 328/667] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:31 2022] DELETE /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:18:31.593736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.595012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] [instance: 90285ea2-a28f-4844-9a8a-652ecafc72ef] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.606126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.606578 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.607359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.607796 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.626000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] HTTP exception thrown: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Request method failure captured: May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef HTTP/1.1 May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpMWYaetFOfnC3G8xBWR_dknxFKsjFBHXQ6cZ1G4tip2__F_DFmABrm31LPvJc1CAmqYCOwQh5-x0oG2TCnfuW1hgU155XWXOc-sAF-QUMdgyNMdvWl0Z5WDeMmHLyxANZBjVquApErJC9HcwwQwHfHU77jHlwEa0-AcJOv7vUdUww May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:31.628676 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_72d5173b32b5480790babb3d178b94fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/72d5173b32b5480790babb3d178b94fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 72d5173b32b5480790babb3d178b94fb May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeTestJSON-606582686 May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 097084a3e57540d18bae448da3b3ecc4 May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeTestJSON-606582686-project May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.630206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '90285ea2-a28f-4844-9a8a-652ecafc72ef'} May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:31.634749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. May 27 15:18:31.637855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:31.639165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] Returning 404 to user: Instance 90285ea2-a28f-4844-9a8a-652ecafc72ef could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:31.639165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7b54eba0-f69b-4240-a7f8-db7af7287fdc tempest-AttachVolumeTestJSON-606582686 tempest-AttachVolumeTestJSON-606582686-project] 10.222.0.41 "GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef" status: 404 len: 111 microversion: 2.1 time: 0.043837 May 27 15:18:31.639165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 329/668] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/90285ea2-a28f-4844-9a8a-652ecafc72ef => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:31.717771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:31.725951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3e222c97-8e79-40b3-b1f9-190807b318bb tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1520 microversion: 2.1 time: 0.185745 May 27 15:18:31.727225 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 340/669] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:32.321227 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.322305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.329092 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.329803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.331507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.332476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.350484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 HTTP/1.1 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:32.352492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.354065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'd5d00cd5-e391-4c55-a071-152ec1cf4c04'} May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:32.354964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.356345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:32.358534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:32.359550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4bd6e46e-2117-493d-822f-e715539ac0e3 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 404 len: 111 microversion: 2.1 time: 0.043648 May 27 15:18:32.364385 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 330/670] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:18:32 2022] DELETE /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:32.369874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.371292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] [instance: d5d00cd5-e391-4c55-a071-152ec1cf4c04] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.381971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.382696 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.384258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.388033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.404910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] HTTP exception thrown: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Request method failure captured: May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 HTTP/1.1 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOpSzMxieuqq-1VHk17mOqsZvCQwwyX7AXgrE5-n1FMz0jvarpaTJepU2ReOKlf4N6NsW_8TpKVeW6KiWY9cxeqv9pvDB-IK0A6PDHBLmlOUUEMQ2iFvkfIM3DDbNZEzqOg0PqRZDwoNy7aEw3a3uakst-jdSf6x3y9GJioP9VQOmOk May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:32.406747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc1a70bd2ce64fbcb738a2cfcfb09f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: cc1a70bd2ce64fbcb738a2cfcfb09f41 May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2068655644 May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: ced10e76e5cc4443819157c821f82226 May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeNegativeTest-2068655644-project May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.409071 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'd5d00cd5-e391-4c55-a071-152ec1cf4c04'} May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:32.409955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. May 27 15:18:32.411428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:32.413529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] Returning 404 to user: Instance d5d00cd5-e391-4c55-a071-152ec1cf4c04 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:32.414538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6a1fb11a-18e4-4a03-b7c6-514e32f0b995 tempest-AttachVolumeNegativeTest-2068655644 tempest-AttachVolumeNegativeTest-2068655644-project] 10.222.0.41 "GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04" status: 404 len: 111 microversion: 2.1 time: 0.049291 May 27 15:18:32.415439 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 341/671] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:32 2022] GET /compute/v2.1/servers/d5d00cd5-e391-4c55-a071-152ec1cf4c04 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:32.438656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-cbe8a8be-b424-4438-86b9-e3ad8e3f2d90 req-f03d54d7-a268-4647-9f5b-61df1c58c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "name": "network-vif-unplugged", "status": "completed", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:32.453369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-cbe8a8be-b424-4438-86b9-e3ad8e3f2d90 req-f03d54d7-a268-4647-9f5b-61df1c58c5fe service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.454022 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-cbe8a8be-b424-4438-86b9-e3ad8e3f2d90 req-f03d54d7-a268-4647-9f5b-61df1c58c5fe service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.489818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-cbe8a8be-b424-4438-86b9-e3ad8e3f2d90 req-f03d54d7-a268-4647-9f5b-61df1c58c5fe service nova] Creating event network-vif-unplugged:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:18:32.498006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-cbe8a8be-b424-4438-86b9-e3ad8e3f2d90 req-f03d54d7-a268-4647-9f5b-61df1c58c5fe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063535 May 27 15:18:32.502285 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 331/672] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:32.748102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.753378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.760885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.761608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.762836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.763609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.947781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:32.956137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0acdddfe-0cd0-4616-982d-e94a7ba6c55d tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.216129 May 27 15:18:32.956974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 342/673] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:32 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:33.976965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:33.978570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:33.985575 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.986358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.988386 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.989070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.532225 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:34.541371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c023a46b-46a5-463f-9ab6-b4e4fe266274 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.570783 May 27 15:18:34.542342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 332/674] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:33 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:35.560207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:35.561422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:35.576932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.580183 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.582011 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.582011 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.870363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:35.881104 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a46a866f-725b-4c28-8400-8ce49b6d35df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.325674 May 27 15:18:35.881676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 343/675] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:35 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:36.898878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.899505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.906319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.906769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.907655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.908683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.089047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:37.098507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-241233ea-2a22-4533-9a6b-004b4d0b7685 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.203580 May 27 15:18:37.099161 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 333/676] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:36 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.039097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eded561d-7fc5-43ac-adb2-d3b036fb38fa tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Action: 'create', calling method: .version_select at 0x7fa371cce040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1248297699", "metadata": {"Type": "work"}}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eded561d-7fc5-43ac-adb2-d3b036fb38fa tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 122 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:38.055658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1248297699", "metadata": {"Type": "work"}}} May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:18:38.057267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1248297699', 'metadata': {'Type': 'work'}}}} May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise error May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi '#$%' May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.058084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:18:38.059406 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:18:38.060650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:18:38.060650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.060650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eded561d-7fc5-43ac-adb2-d3b036fb38fa tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.060650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eded561d-7fc5-43ac-adb2-d3b036fb38fa tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.253866 May 27 15:18:38.060650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 344/677] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 15:18:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:18:38.068913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-15bc2b4c-0ef7-4966-bda5-bddba91dad09 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Action: 'create', calling method: .version_select at 0x7fa3726299d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-836911244", "metadata": {"Type": "work"}}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-15bc2b4c-0ef7-4966-bda5-bddba91dad09 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 119 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:38.072201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-836911244", "metadata": {"Type": "work"}}} May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: May 27 15:18:38.073834 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-836911244', 'metadata': {'Type': 'work'}}}} May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise error May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi '0' May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.074849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:18:38.076398 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:18:38.079109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:18:38.079109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.079109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-15bc2b4c-0ef7-4966-bda5-bddba91dad09 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.079109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-15bc2b4c-0ef7-4966-bda5-bddba91dad09 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009171 May 27 15:18:38.079109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 334/678] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 15:18:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:18:38.083761 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-524826b1-727b-4ddc-a69f-ecbfd6f51602 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Action: 'create', calling method: .version_select at 0x7fa371db4af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1837526678", "metadata": {"Type": "work"}}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-524826b1-727b-4ddc-a69f-ecbfd6f51602 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 119 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:18:38.086973 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1837526678", "metadata": {"Type": "work"}}} May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: May 27 15:18:38.088400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1837526678', 'metadata': {'Type': 'work'}}}} May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise error May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi '' May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.089303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:18:38.090659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:18:38.091856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:18:38.091856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:18:38.091856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-524826b1-727b-4ddc-a69f-ecbfd6f51602 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.091856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-524826b1-727b-4ddc-a69f-ecbfd6f51602 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008921 May 27 15:18:38.091856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 345/679] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 15:18:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 15:18:38.100181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0b613c82-d2af-45eb-b3cf-485eea9824d8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Calling method '.version_select at 0x7fa3726a7af0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.117674 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.118571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:38.124716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.125171 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.125952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.126395 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.132399 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-0b613c82-d2af-45eb-b3cf-485eea9824d8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] HTTP exception thrown: Volume tempest-invalid-123901157 could not be found. May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0b613c82-d2af-45eb-b3cf-485eea9824d8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-123901157 HTTP/1.1 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:38.134507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Volume tempest-invalid-123901157 could not be found. May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'tempest-invalid-123901157'} May 27 15:18:38.135867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-123901157 could not be found. (HTTP 404) (Request-ID: req-9fd3796c-6828-4bba-9e29-8f9850856829) May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.136687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:18:38.137879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-123901157 could not be found. May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:38.138990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-123901157 could not be found. May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-123901157 could not be found. May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0b613c82-d2af-45eb-b3cf-485eea9824d8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 404 to user: Volume tempest-invalid-123901157 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0b613c82-d2af-45eb-b3cf-485eea9824d8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-123901157" status: 404 len: 98 microversion: 2.1 time: 0.040539 May 27 15:18:38.140238 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 335/680] 10.222.0.41 () {58 vars in 1214 bytes} [Fri May 27 15:18:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-123901157 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:18:38.151335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-da696546-61f6-4a82-bf92-f7484e123ef2 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004480 May 27 15:18:38.151868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 336/681] 10.222.0.41 () {58 vars in 1139 bytes} [Fri May 27 15:18:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:18:38.161155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f7848acb-684d-4298-9076-481605a5afd7 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003930 May 27 15:18:38.165785 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 337/682] 10.222.0.41 () {58 vars in 1136 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:18:38.170988 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e791af6d-818c-49a8-aaee-4c7feab222e8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Calling method '.version_select at 0x7fa372629f70>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.207301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-e791af6d-818c-49a8-aaee-4c7feab222e8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] HTTP exception thrown: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e791af6d-818c-49a8-aaee-4c7feab222e8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: DELETE /compute/v2.1/os-volumes/5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 HTTP/1.1 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:38.209289 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '5cb7d486-8ea4-40a7-b247-c03da6ed0fe3'} May 27 15:18:38.210572 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. (HTTP 404) (Request-ID: req-8ff85cf1-e392-4ecb-9d24-f5b6a16bfef3) May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.211341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:18:38.212515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:18:38.214535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e791af6d-818c-49a8-aaee-4c7feab222e8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 404 to user: Volume 5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e791af6d-818c-49a8-aaee-4c7feab222e8 tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/5cb7d486-8ea4-40a7-b247-c03da6ed0fe3" status: 404 len: 109 microversion: 2.1 time: 0.043756 May 27 15:18:38.216696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 338/683] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 15:18:38 2022] DELETE /compute/v2.1/os-volumes/5cb7d486-8ea4-40a7-b247-c03da6ed0fe3 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:38.224095 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e230f77c-39ef-4744-a4b9-ad9f5c6ec02e tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Calling method '.version_select at 0x7fa3727f04c0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.258743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-e230f77c-39ef-4744-a4b9-ad9f5c6ec02e tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] HTTP exception thrown: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e230f77c-39ef-4744-a4b9-ad9f5c6ec02e tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Request method failure captured: May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/os-volumes/c29e0556-ef8f-465b-834b-04b43e889e80 HTTP/1.1 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOvNrmbmtfDFCaX2GSuHfliCqb9B1MrdXq-9QAt1lv2sWMrQFyXNlgRORwUShPtnUlj7VLlpTDKhRjQtFSOEmcFN09ZWlcXQJufA8YHyqWUg7OcqhRWqsjBJx3i1HSA3N4iG-ZwT6Njj7u1MWd2zpZ8pJ0C-kOnbnhe6NH4Xn7qJqYE May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:18:38.260948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/f522ae7a4fb74ca79ba67ced34d92c84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: f522ae7a4fb74ca79ba67ced34d92c84 May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesNegativeTest-142104362 May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 110ca5f109264b64a79ad38aaa93e7f7 May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesNegativeTest-142104362-project May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'c29e0556-ef8f-465b-834b-04b43e889e80'} May 27 15:18:38.262552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. (HTTP 404) (Request-ID: req-9c952264-77b2-41db-98d4-fa7f175de7ab) May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.263519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:18:38.264925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:18:38.266307 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. May 27 15:18:38.268014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:18:38.269898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e230f77c-39ef-4744-a4b9-ad9f5c6ec02e tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] Returning 404 to user: Volume c29e0556-ef8f-465b-834b-04b43e889e80 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:38.270753 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e230f77c-39ef-4744-a4b9-ad9f5c6ec02e tempest-VolumesNegativeTest-142104362 tempest-VolumesNegativeTest-142104362-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c29e0556-ef8f-465b-834b-04b43e889e80" status: 404 len: 109 microversion: 2.1 time: 0.051761 May 27 15:18:38.271300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 339/684] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/os-volumes/c29e0556-ef8f-465b-834b-04b43e889e80 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:38.288929 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:38.297002 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c42ef38f-8d14-40dc-b394-161f895ac2f7 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.184065 May 27 15:18:38.307948 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 346/685] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:39.315050 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:39.315705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:39.322560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.323020 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.323824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.324383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.463964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:39.472646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0ada8f2f-b954-458e-855a-1b7da9b9e933 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1576 microversion: 2.1 time: 0.162102 May 27 15:18:39.473272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 340/686] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:39 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:40.491771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:40.493234 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:40.501230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.501771 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.503252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.503701 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.643515 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:40.651218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-957c741b-234e-4528-a38c-71d7d893f8e1 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1563 microversion: 2.1 time: 0.165597 May 27 15:18:40.652006 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 347/687] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:18:40 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:42.828107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-112063b0-c1a2-42bd-b4ad-d053f06dc906 req-48390de7-2b99-40b4-9bac-494e277a9ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "name": "network-vif-plugged", "status": "completed", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:42.837434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-112063b0-c1a2-42bd-b4ad-d053f06dc906 req-48390de7-2b99-40b4-9bac-494e277a9ce0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.837965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-112063b0-c1a2-42bd-b4ad-d053f06dc906 req-48390de7-2b99-40b4-9bac-494e277a9ce0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.854430 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-112063b0-c1a2-42bd-b4ad-d053f06dc906 req-48390de7-2b99-40b4-9bac-494e277a9ce0 service nova] Creating event network-vif-plugged:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:18:42.860827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-112063b0-c1a2-42bd-b4ad-d053f06dc906 req-48390de7-2b99-40b4-9bac-494e277a9ce0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 May 27 15:18:42.862345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 341/688] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:43.579018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.581124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.588384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.588877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.589810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.590261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.617842 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d0388c3a-5adc-421c-ab01-228065ed3b6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/ips" status: 200 len: 150 microversion: 2.20 time: 0.043124 May 27 15:18:43.618423 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 348/689] 10.222.0.41 () {60 vars in 1288 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:18:46.067118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:46.067742 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.074118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.074589 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.075365 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.075809 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.099508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lazy-loading 'flavor' on Instance uuid 734d5d69-34eb-44a2-a662-0399f6fb4932 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:46.429570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7ddd2f10-7f54-4a6d-9178-65d16ba1b1cf tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/action" status: 202 len: 0 microversion: 2.20 time: 0.366822 May 27 15:18:46.430196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 342/690] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 15:18:46 2022] POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:46.438569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.439235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.453334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.454012 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.455743 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.456903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.619782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.628770 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.630401 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.631824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-80551a5e-6e4e-4149-9a13-54ea52add87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.197007 May 27 15:18:46.632677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 349/691] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:47.652106 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:47.652734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:47.661283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.661744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.662528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.662965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.800429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.808568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.810088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.811244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-243a866d-1f18-4c6b-b063-5855e182396c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.164011 May 27 15:18:47.811801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 343/692] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:47 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:48.828912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.830856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.837412 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.837841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.838610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.839101 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.028811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:49.037566 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:49.039061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:49.040205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4f91c54b-4b1f-4164-aaae-0edd0d5ef3ff tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.215194 May 27 15:18:49.040873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 350/693] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:50.059425 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:50.060043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:50.067551 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:50.067810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:50.068739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:50.069181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:50.210810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.222881 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.224904 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.226123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-046f0d6e-1e16-4506-bc8d-cc1a9602b09b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.170890 May 27 15:18:50.227054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 344/694] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:50 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:51.252554 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:51.253177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:51.259699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.260165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.260946 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.261388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.397048 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:51.405310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:51.406869 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:51.408546 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5ba5a0df-c2e4-4e8a-a38b-2f35dc97ab30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.166287 May 27 15:18:51.409107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 351/695] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:51 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:52.427211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:52.427830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:52.434397 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.434852 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.435965 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.436599 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.603625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.616675 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.618604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.619786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d75862bc-939b-4afd-9947-cc63ba04cf75 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.197023 May 27 15:18:52.620699 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 345/696] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:52 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:53.637848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:53.638759 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:53.645337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.646017 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.646987 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.647434 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.802347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:53.810589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:53.812125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:53.813327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7c8034a1-5b08-4745-8e96-fe3babf6adc1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.179595 May 27 15:18:53.814140 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 352/697] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:53 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:18:54.832506 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:54.833096 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:54.839509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.839958 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.840752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.841182 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.040057 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:55.056872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:55.058394 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:55.059578 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-edd16c32-580b-451d-b273-8146d5135150 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.232429 May 27 15:18:55.078065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 346/698] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:54 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:56.078718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:56.079831 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:56.082651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:56.089073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:56.089651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:56.090425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:56.091064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:56.241630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:56.250998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:56.253408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:56.254581 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-79d5d9de-6b9e-4dc4-b431-314f82ea9268 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.179940 May 27 15:18:56.255167 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 353/699] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:56 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:57.274272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.275820 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:57.282555 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.283155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.283991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.284405 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.435083 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.444704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.446335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.447845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8fb203d3-31fc-4b5c-a253-aa8bbbc7655f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1743 microversion: 2.20 time: 0.178469 May 27 15:18:57.448384 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 347/700] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:57 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:58.466935 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.467643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:58.475465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.475994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.476837 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.477275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.710195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.721096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.723603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.724961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-afae4b4e-5e50-4498-98c2-f503378313b4 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1743 microversion: 2.20 time: 0.261866 May 27 15:18:58.725638 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 354/701] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:59.744133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.744782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:59.754979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.755672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.756658 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.757109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.005465 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.018295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.021828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.024873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c0cba141-3c8c-40e0-a07d-b92df0e60e90 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.285341 May 27 15:19:00.029532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 348/702] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:18:59 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:00.705857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-4dc45e2d-2d6d-44e4-980f-ba3e82190f09 req-480306a0-d298-4708-88a7-baae3f379610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "name": "network-vif-plugged", "status": "completed", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:00.724315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-4dc45e2d-2d6d-44e4-980f-ba3e82190f09 req-480306a0-d298-4708-88a7-baae3f379610 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.725067 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-4dc45e2d-2d6d-44e4-980f-ba3e82190f09 req-480306a0-d298-4708-88a7-baae3f379610 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.741932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-4dc45e2d-2d6d-44e4-980f-ba3e82190f09 req-480306a0-d298-4708-88a7-baae3f379610 service nova] Creating event network-vif-plugged:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:19:00.749433 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-4dc45e2d-2d6d-44e4-980f-ba3e82190f09 req-480306a0-d298-4708-88a7-baae3f379610 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050828 May 27 15:19:00.750355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 355/703] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:01.047314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:01.047933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:01.055872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=40 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:01.058163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.058639 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.059425 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.059872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.077895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:01.265939 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.274706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.278709 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.279670 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1c5febe8-b777-4b18-a137-e5b479f5f902 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.236349 May 27 15:19:01.280365 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 349/704] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:01 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:02.300049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:02.300932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:02.326700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:02.335537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:02.337620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:02.338185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:02.342947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=78 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:02.559910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:02.582791 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:02.585930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:02.588511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ad225f5-dd66-47a3-9708-072d2416b7b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.292742 May 27 15:19:02.596583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 356/705] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:02 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:03.609824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:03.610440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:03.619609 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.620315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.621329 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.621963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.853343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:03.871751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:03.876854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:03.881492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a591e71f-69ee-42e4-9917-f01e1cb93de0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.276180 May 27 15:19:03.883253 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 350/706] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:03 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:04.908711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:04.910754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:04.922623 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.924352 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:04.926882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.927599 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:05.103035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:05.114042 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:05.116612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:05.117964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8ab35552-06a1-46b3-bd2f-356a64d23d65 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.215410 May 27 15:19:05.118626 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 357/707] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:04 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:06.141486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:06.142257 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:06.169242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:06.171097 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:06.172078 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:06.178541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:06.361741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:06.373075 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:06.374939 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:06.376479 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8f232aad-3def-4829-b65f-2ec87cce4c6c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.242779 May 27 15:19:06.377144 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 351/708] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:06 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:07.395749 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.397004 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:07.403848 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.404308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:07.405248 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.406930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:07.551070 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:07.559238 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:07.561169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:07.564987 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c095d532-e554-40ee-9eb7-6c5fb01e939b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.173922 May 27 15:19:07.566376 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 358/709] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:08.583848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:08.584506 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:08.600996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:08.601669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:08.603025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:08.603859 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:08.790425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-496509394", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "networks": [{"uuid": "213aea26-8a43-4bbb-8b1f-a6f47a97721b"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:08.839588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:08.849563 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:08.851442 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:08.854196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-22b47003-9ba2-48db-ab5b-8b2c22e3c0f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.274138 May 27 15:19:08.855521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 352/710] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:08 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:08.863713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] validate_networks() for [('213aea26-8a43-4bbb-8b1f-a6f47a97721b', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:09.280095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:09.280582 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:09.281021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:09.281449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:09.281859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:09.291217 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.291656 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.292454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.292904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.309716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Getting quotas for project ca5780630fe8464a99e6afe51c9bd3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:09.314162 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Getting quotas for user 4555cb3933ec45e687a72632857be7dd and project ca5780630fe8464a99e6afe51c9bd3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:09.325647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:09.327905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:09.391195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21862cf6-4858-407f-b5c1-297b3cf6991d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606219 May 27 15:19:09.393177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 359/711] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:09.405779 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-01676cb8-a4eb-4685-a865-776c8d4d5d3a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.406972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-01676cb8-a4eb-4685-a865-776c8d4d5d3a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:09.474707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-01676cb8-a4eb-4685-a865-776c8d4d5d3a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:09.482026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-01676cb8-a4eb-4685-a865-776c8d4d5d3a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1213 microversion: 2.1 time: 0.080727 May 27 15:19:09.482590 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 353/712] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:09.874745 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.875929 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:09.883301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.884065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.885527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.886180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.076284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:10.086774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:10.088393 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:10.089698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bdabd8b8-1736-4d13-a9a7-4e1ea484aaf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1738 microversion: 2.20 time: 0.219834 May 27 15:19:10.101488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 360/713] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:10.501836 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:10.502452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:10.508400 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.509014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.509772 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.510206 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.573730 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:10.581984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fbbc929e-8b15-44cf-87da-3f3ea42b25f8 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1265 microversion: 2.1 time: 0.084260 May 27 15:19:10.582596 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 354/714] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:10 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:11.109420 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:11.111428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:11.118078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.118901 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.119754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.120466 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.383556 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:11.399092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:11.400649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:11.402069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f4150fb5-553d-451c-89d3-dad4a9a05d91 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1720 microversion: 2.20 time: 0.297979 May 27 15:19:11.414271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 361/715] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:11 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:11.602301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:11.603832 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:11.612124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.612957 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.614501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.615261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.056714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:12.066529 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-00fba1a7-59cf-49a0-bbe6-83307348a65b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.470232 May 27 15:19:12.067113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 355/716] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:11 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:12.421378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:12.422066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:12.429639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.430018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.430823 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.431257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.570950 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:12.578340 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:12.580629 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:12.581799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-32da28db-9293-41a9-acd4-f39ac8aa2e03 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1720 microversion: 2.20 time: 0.164320 May 27 15:19:12.582350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 362/717] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:12 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:13.084954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:13.085802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:13.093209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:13.094183 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.095359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:13.096468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.287863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.295363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b59572be-51fb-4a70-bb67-4854479d2b11 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.216079 May 27 15:19:13.295935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 356/718] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:13 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:13.606326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:13.607454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:13.615574 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:13.616123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.617048 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:13.617636 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.871287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.879885 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.881428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.882589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c4d4394d-22fe-4df1-827b-d60fa93bade0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1720 microversion: 2.20 time: 0.286190 May 27 15:19:13.883151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 363/719] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:13 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:14.313314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:14.313314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:14.331000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.331482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.332272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.332754 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.619223 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-2f7d8acd-de7d-45a7-bac2-ec5d9f99b004 req-28d03c22-caa3-4e14-bd91-b1659c945e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "name": "network-vif-unplugged", "status": "completed", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:14.635830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2f7d8acd-de7d-45a7-bac2-ec5d9f99b004 req-28d03c22-caa3-4e14-bd91-b1659c945e7f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.636279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-2f7d8acd-de7d-45a7-bac2-ec5d9f99b004 req-28d03c22-caa3-4e14-bd91-b1659c945e7f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.645894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:14.653523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5f8a9793-6efe-4472-b4e2-b49ce1e300b9 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.344715 May 27 15:19:14.656031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.compute.server_external_events [req-2f7d8acd-de7d-45a7-bac2-ec5d9f99b004 req-28d03c22-caa3-4e14-bd91-b1659c945e7f service nova] Unable to find a host for instance 734d5d69-34eb-44a2-a662-0399f6fb4932. Dropping event network-vif-unplugged {{(pid=117642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 15:19:14.657806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 357/720] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:14 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:14.659072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-2f7d8acd-de7d-45a7-bac2-ec5d9f99b004 req-28d03c22-caa3-4e14-bd91-b1659c945e7f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044941 May 27 15:19:14.659818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 364/721] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 15:19:14.901403 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:14.902013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:14.909076 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.909570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.910601 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.911113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.238347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:15.249904 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:15.252244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:15.253937 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ce738a6e-3554-477f-a075-ae08098a45d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1663 microversion: 2.20 time: 0.355981 May 27 15:19:15.255358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 358/722] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:14 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1663 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:15.272926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a28a7e5-4fc4-4efd-b115-6df5de9b909b"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:15.274001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:15.283264 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.286587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.289472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.289921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.421877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-b793c2b5-5108-44e9-a162-e8899596143a req-8b967c14-3950-42ef-935d-e4b537e9d81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59193668-f146-4b44-81d1-df1dde4fbfd7", "tag": "02bf099e-c728-4741-8d09-1373eff74fb3"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:15.449883 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b793c2b5-5108-44e9-a162-e8899596143a req-8b967c14-3950-42ef-935d-e4b537e9d81a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.450693 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b793c2b5-5108-44e9-a162-e8899596143a req-8b967c14-3950-42ef-935d-e4b537e9d81a service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.476608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-b793c2b5-5108-44e9-a162-e8899596143a req-8b967c14-3950-42ef-935d-e4b537e9d81a service nova] Creating event network-changed:02bf099e-c728-4741-8d09-1373eff74fb3 for instance 59193668-f146-4b44-81d1-df1dde4fbfd7 on hv-cinder-84254 May 27 15:19:15.482294 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-b793c2b5-5108-44e9-a162-e8899596143a req-8b967c14-3950-42ef-935d-e4b537e9d81a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068503 May 27 15:19:15.483342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 359/723] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:15.674283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:15.675251 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:15.681945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.682600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.683539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.684129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.724024 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1c14fadc-80be-45d7-bd1a-2bd9aab00f10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.455021 May 27 15:19:15.725864 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 365/724] 10.222.0.41 () {62 vars in 1363 bytes} [Fri May 27 15:19:15 2022] POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 188 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:19:15.855250 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:15.855883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:15.862975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.863427 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.864259 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.864722 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.944347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-654ac68a-2311-4dae-8ceb-a1897b1085f7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/action" status: 202 len: 0 microversion: 2.20 time: 0.093326 May 27 15:19:15.948571 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 366/725] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 15:19:15 2022] POST /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 15:19:15.953619 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:15.954495 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:15.961859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.962309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.963371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.963982 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:16.312608 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.322449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2b19ffbc-b42b-45a8-a408-b9952bf42966 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.652333 May 27 15:19:16.333810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 360/726] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:15 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:16.483684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.495525 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.497989 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.500242 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-280cd8c6-9341-4ca9-92bf-d8b04aa903c5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1749 microversion: 2.20 time: 0.550017 May 27 15:19:16.501229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 367/727] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:15 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1749 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:17.343640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:17.344724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:17.352854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.353503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.354450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.355055 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.520546 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:17.522051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:17.529438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.530375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.531386 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.532134 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.883860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:17.896858 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-79036fa6-dca9-465c-ad3d-dfea99f50e92 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.559312 May 27 15:19:17.899324 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 361/728] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:17 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:17.987372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:18.000379 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:18.003490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:18.005066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-214c8b80-4550-45ad-84b0-93eb150c91ab tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1751 microversion: 2.20 time: 0.489772 May 27 15:19:18.005687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 368/729] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:17 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1751 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:18.915534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.916140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:18.924927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.925655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:18.927181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.927975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.026199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:19.027061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:19.035290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.035735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.036532 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.036969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.300069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:19.321030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:19.479520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:19.624150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:19.632408 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d9363db3-ef32-4274-b9f3-4421144a80da tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.720702 May 27 15:19:19.633092 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 362/730] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:18 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:19.693075 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:19.704235 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:19.705800 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:19.707144 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-11dda0b8-12c4-4136-80ea-9d71d017f0b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.686117 May 27 15:19:19.707684 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 369/731] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:19 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:20.651672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:20.653637 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:20.667432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.667897 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.668721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.669169 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.727012 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:20.728291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:20.743645 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.744127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.747855 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.751642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.823963 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:21.069385 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.077839 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-631c5a4b-4e2d-4458-adc8-da2485db2e0a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.431342 May 27 15:19:21.081575 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 363/732] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:20 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:21.154300 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.166558 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.170088 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.173516 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9f3a483e-a771-4819-ba29-f2f933c1e4f6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.450869 May 27 15:19:21.176162 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 370/733] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:20 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:21.252632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-c764e68e-161a-4f86-a2fa-9df150f41b76 req-5e1f5c73-6cca-4acf-b2ce-4fef980705b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59193668-f146-4b44-81d1-df1dde4fbfd7", "name": "network-vif-plugged", "status": "completed", "tag": "02bf099e-c728-4741-8d09-1373eff74fb3"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:21.272126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-c764e68e-161a-4f86-a2fa-9df150f41b76 req-5e1f5c73-6cca-4acf-b2ce-4fef980705b5 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.274662 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-c764e68e-161a-4f86-a2fa-9df150f41b76 req-5e1f5c73-6cca-4acf-b2ce-4fef980705b5 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.310200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-c764e68e-161a-4f86-a2fa-9df150f41b76 req-5e1f5c73-6cca-4acf-b2ce-4fef980705b5 service nova] Creating event network-vif-plugged:02bf099e-c728-4741-8d09-1373eff74fb3 for instance 59193668-f146-4b44-81d1-df1dde4fbfd7 on hv-cinder-84254 May 27 15:19:21.320309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-c764e68e-161a-4f86-a2fa-9df150f41b76 req-5e1f5c73-6cca-4acf-b2ce-4fef980705b5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081097 May 27 15:19:21.321984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 364/734] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:22.099471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:22.100827 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:22.112876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.113718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.116974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.117602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.195172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:22.199708 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:22.218712 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.220760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.225214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.226037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.469054 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.480654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b42a9bac-e7ec-4955-9a5b-a7e223732012 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.384770 May 27 15:19:22.488760 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 371/735] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:22 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:22.600561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.611471 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.613777 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.615408 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6bc1328b-bab5-49ef-84f5-ee4de322cb22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.425129 May 27 15:19:22.616563 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 365/736] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:22 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:23.506788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:23.508002 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:23.518813 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.522798 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.529718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.533237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.649354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:23.651059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:23.673792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.676440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.677597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.679082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.026737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:24.035643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ead70da7-49fc-4e5b-a894-d91dc740e2c7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.534585 May 27 15:19:24.036226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 372/737] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:23 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:24.078724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:24.096637 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:24.104734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:24.108655 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-af9d8e7c-b038-4f89-b262-598a5503f938 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.465562 May 27 15:19:24.121959 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 366/738] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:23 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:25.055762 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.056363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:25.064670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.065509 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.066472 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.067241 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.127499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.128347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:25.139792 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.142667 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.144643 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.150744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.710115 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.726408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f9267c63-6dc8-453d-9957-05aea4cd22b6 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1313 microversion: 2.1 time: 0.674794 May 27 15:19:25.727089 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 373/739] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:25 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:25.812570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.828682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.831351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.841864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1cc4c170-f364-4d83-b8cb-f2b4e753c9b1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.718588 May 27 15:19:25.863835 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 367/740] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:25 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:26.745115 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.746476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.749682 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:26.762790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.770425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.772609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.778099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.885570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.887507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.933939 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.934448 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.953850 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.959971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.963993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=100 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:27.417675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:27.432691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-580f794d-76a8-4810-ab62-469ec0419414 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1497 microversion: 2.1 time: 0.690947 May 27 15:19:27.434999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 374/741] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1497 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:27.753983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:27.781079 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:27.783220 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:27.807036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3564f672-6c75-49bc-8418-07f85e168bcb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.917042 May 27 15:19:27.810177 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 368/742] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:28.099868 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:28.101141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:28.131261 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.132105 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.138208 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.139022 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.200096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:28.396221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-aacbe73d-4443-4ab3-860b-c3f6d6490e6f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 204 len: 0 microversion: 2.1 time: 0.302268 May 27 15:19:28.396221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 375/743] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:19:28 2022] DELETE /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:28.404696 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:28.405339 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:28.416560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.416807 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.417513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.417962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.645660 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:28.653239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2d3e0bfe-b962-4593-a938-75c59b05808f tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1503 microversion: 2.1 time: 0.252582 May 27 15:19:28.654993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 369/744] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:28 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:28.749498 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5d83e0e7-bfbb-4b62-9374-11e64f0fa145 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Action: 'create', calling method: .version_select at 0x7fa371cd65e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-938155760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVyHc0Kd9dQUexu1ss5FlHUcVMvbUke99RCSQXky0b01GNY+XyM3gyW84CbJXMMQ7edKve/cHAyjtashH2mLg6WsbhpvOVOlbu/USuS3/YJb73yfd0qkxn4ADQOntDDKA=="}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:28.763401 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-5d83e0e7-bfbb-4b62-9374-11e64f0fa145 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for project 67116cdacaa846138f7835ac5f53b863. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:28.767398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-5d83e0e7-bfbb-4b62-9374-11e64f0fa145 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for user 60ff7c679e9747898bbc44da1d885b36 and project 67116cdacaa846138f7835ac5f53b863. Resources: {'key_pairs'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:28.789655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5d83e0e7-bfbb-4b62-9374-11e64f0fa145 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.234622 May 27 15:19:28.790417 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 376/745] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 15:19:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:28.830574 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:28.833304 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:28.840583 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.841107 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.841961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.842469 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.031023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:29.040729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:29.042309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:29.043483 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-90508e37-9761-4eb0-9a6c-5ae94fd2e5be tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.220060 May 27 15:19:29.045188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 370/746] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:28 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:29.674246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:29.675170 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:29.690700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.691442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.692405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.693110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.960830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:29.973556 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e993d15-5319-42db-966b-43675bb49665 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1503 microversion: 2.1 time: 0.304977 May 27 15:19:29.974593 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 377/747] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:29 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:30.062878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:30.089159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:30.089159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:30.089159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:30.089159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:30.090089 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:30.395163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:30.407497 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:30.410778 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:30.412149 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-72e69ff1-1380-42c0-8319-41fc7e861cc8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.353740 May 27 15:19:30.413117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 371/748] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:30 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:30.994000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:30.995283 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:31.003453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.011920 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.017372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.027336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.301351 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.315190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2c66ef5e-5c92-4618-8c20-3ba46ad17ed5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1503 microversion: 2.1 time: 0.326019 May 27 15:19:31.316911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 378/749] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:30 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:31.439472 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:31.440127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:31.442731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=48 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:31.461574 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.462314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.463303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.463911 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.644111 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.654233 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.656406 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.658579 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8fe9f02c-1153-41c9-aa2b-98a7d980318c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.230606 May 27 15:19:31.659157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 372/750] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:31 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:32.349463 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:32.350721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:32.357529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.357980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.359047 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.359388 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.590755 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:32.598505 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-06bb8574-5d16-4a79-a96e-8353f582b910 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 200 len: 1503 microversion: 2.1 time: 0.266355 May 27 15:19:32.599061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 379/751] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:32 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:32.676172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:32.676810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:32.683491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.683968 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.684766 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.685262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.816600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-75cc3667-2822-4408-a86f-d35bf6a8c51e req-4606dd5b-9cbb-4352-bd32-37e639ca3493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59193668-f146-4b44-81d1-df1dde4fbfd7", "name": "network-vif-deleted", "tag": "02bf099e-c728-4741-8d09-1373eff74fb3"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:32.826268 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-75cc3667-2822-4408-a86f-d35bf6a8c51e req-4606dd5b-9cbb-4352-bd32-37e639ca3493 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.827099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-75cc3667-2822-4408-a86f-d35bf6a8c51e req-4606dd5b-9cbb-4352-bd32-37e639ca3493 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.840375 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-75cc3667-2822-4408-a86f-d35bf6a8c51e req-4606dd5b-9cbb-4352-bd32-37e639ca3493 service nova] Creating event network-vif-deleted:02bf099e-c728-4741-8d09-1373eff74fb3 for instance 59193668-f146-4b44-81d1-df1dde4fbfd7 on hv-cinder-84254 May 27 15:19:32.846957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-75cc3667-2822-4408-a86f-d35bf6a8c51e req-4606dd5b-9cbb-4352-bd32-37e639ca3493 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035656 May 27 15:19:32.847577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 380/752] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:33.140192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:33.149374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:33.151010 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:33.152248 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-97a49a77-c964-433e-8260-02460dc1dfdb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.480007 May 27 15:19:33.152873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 373/753] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:32 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:33.617448 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:33.618249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 59193668-f146-4b44-81d1-df1dde4fbfd7] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:33.625654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:33.625903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:33.626767 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:33.627255 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:33.641026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] HTTP exception thrown: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Request method failure captured: May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 HTTP/1.1 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOvpkzfYYRER1XBgkqqAcy_n2Ycphwn-cutdZEKZjgswsw_e5e5wqJ0hWqVVXOlL7DtSnX1dozimx_SVRmBd9XlObIcaW0hBSEfCL2Un0W0WZIvGzNx5xUl91iUqOe6s8stPss9hiNqaZmQb4ixFPlAE9nPR2K3VojoXlR2duV24C9M May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: ca5780630fe8464a99e6afe51c9bd3e0 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesActionsTest-82230912 May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:19:33.643301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesActionsTest-82230912 May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: ca5780630fe8464a99e6afe51c9bd3e0 May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesActionsTest-82230912 May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesActionsTest-82230912-project May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 4555cb3933ec45e687a72632857be7dd May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesActionsTest-82230912-project May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. May 27 15:19:33.644838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '59193668-f146-4b44-81d1-df1dde4fbfd7'} May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:33.645691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. May 27 15:19:33.647290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:19:33.648728 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Returning 404 to user: Instance 59193668-f146-4b44-81d1-df1dde4fbfd7 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:33.648728 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-62942719-73c5-4078-acae-b1aad2bb97d7 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7" status: 404 len: 111 microversion: 2.1 time: 0.032647 May 27 15:19:33.648728 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 381/754] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:33 2022] GET /compute/v2.1/servers/59193668-f146-4b44-81d1-df1dde4fbfd7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:19:33.744554 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-821108536", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "networks": [{"uuid": "213aea26-8a43-4bbb-8b1f-a6f47a97721b"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:33.797675 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] validate_networks() for [('213aea26-8a43-4bbb-8b1f-a6f47a97721b', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:34.153339 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:34.153804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:34.154364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:34.154729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:34.155147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:34.164342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.164829 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.165640 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.166085 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.175347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:34.176084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:34.182194 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.182648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.183065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Getting quotas for project ca5780630fe8464a99e6afe51c9bd3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:34.183416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.183858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.187022 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Getting quotas for user 4555cb3933ec45e687a72632857be7dd and project ca5780630fe8464a99e6afe51c9bd3e0. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:34.202369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:34.204800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:34.267290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2930d449-0b19-4401-80dc-8a5b077c038d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526465 May 27 15:19:34.267927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 374/755] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:34.277928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1fbae38e-729a-4393-8e2c-0da7943a7d6c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:34.278550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1fbae38e-729a-4393-8e2c-0da7943a7d6c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:34.342354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1fbae38e-729a-4393-8e2c-0da7943a7d6c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:34.350368 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1fbae38e-729a-4393-8e2c-0da7943a7d6c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1213 microversion: 2.1 time: 0.076314 May 27 15:19:34.351139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 375/756] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:34 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:34.372668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:34.388057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:34.389732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:34.391011 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f6684867-1642-4364-b40b-f92f7ccf9ab1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.219786 May 27 15:19:34.391690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 382/757] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:34 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:35.372187 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.372845 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.380870 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.381571 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.382537 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.383163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.410425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.411412 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.418205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.418733 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.420204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.420751 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.473111 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:35.484431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-700bff04-c1d3-4d8a-8ab2-389dd191abff tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1271 microversion: 2.1 time: 0.120478 May 27 15:19:35.486027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 376/758] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:35 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:35.653654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:35.662822 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:35.664875 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:35.666280 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7b14eeaa-0720-4faa-a814-ca36f8aafcc6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.261006 May 27 15:19:35.666894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 383/759] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:35 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:36.502859 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.503488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.510134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.510704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.511414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.511863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.684936 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.685662 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.692249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.700061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.701069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.701520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.734738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.742803 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2b69a7c0-db1f-486a-be8f-bd6bb2831311 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.244083 May 27 15:19:36.743367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 377/760] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:36.749319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-f707938b-875c-4005-a385-62132df6e1b8 req-115e2d67-40e3-4db5-ac7e-e031848203f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54db1443-32b7-4aa1-91c9-c540abf73d26", "tag": "c51ad7a3-bf83-47f9-9860-aa5a15b5d118"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:36.757997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f707938b-875c-4005-a385-62132df6e1b8 req-115e2d67-40e3-4db5-ac7e-e031848203f9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.758975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-f707938b-875c-4005-a385-62132df6e1b8 req-115e2d67-40e3-4db5-ac7e-e031848203f9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.772880 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-f707938b-875c-4005-a385-62132df6e1b8 req-115e2d67-40e3-4db5-ac7e-e031848203f9 service nova] Creating event network-changed:c51ad7a3-bf83-47f9-9860-aa5a15b5d118 for instance 54db1443-32b7-4aa1-91c9-c540abf73d26 on hv-cinder-84254 May 27 15:19:36.778552 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-f707938b-875c-4005-a385-62132df6e1b8 req-115e2d67-40e3-4db5-ac7e-e031848203f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 May 27 15:19:36.779385 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 378/761] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:36.967563 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.977318 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.978861 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.980033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-be013f97-6013-45d3-bc1d-d007e844b730 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.299031 May 27 15:19:36.980627 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 384/762] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:37.761631 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.762247 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.768804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.769249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.770020 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.770462 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.907242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:37.914731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7549fcdd-bc6f-4854-882c-374228f70e39 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.157983 May 27 15:19:37.915287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 379/763] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:37.998510 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.999118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.005881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.006333 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.007101 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.007542 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.139279 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.148454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.149994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.151158 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0252667b-4009-42c3-b2a4-184c4d890306 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.156646 May 27 15:19:38.151706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 385/764] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:38.931393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.931998 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.939282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.939826 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.940715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.941230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.166234 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:39.173220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.174748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:39.183145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.184850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.186049 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.186494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.204303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.248784 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a055e32c-2252-464d-b0e2-c947cf353ebe tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.321052 May 27 15:19:39.249787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 380/765] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:39.401125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.409858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.411372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.412760 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e86dcdb3-8267-476d-9aeb-32c67c07b735 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.247431 May 27 15:19:39.413314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 386/766] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:40.266686 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.267469 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.273846 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.274301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.275086 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.275549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.410230 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.417672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6edad38a-541a-47d1-9dee-142459f98503 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.155426 May 27 15:19:40.418228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 381/767] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:40.430922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.431526 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.438069 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.438579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.439344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.439816 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.574506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.576698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:40.586304 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.587825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.589061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4d9966bd-6518-40b2-8c67-63c81945f880 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.162018 May 27 15:19:40.589622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 387/768] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:40.971120 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-0d32d17c-1b7c-4abb-acf6-e3d10d8c7548 req-5d309d6a-22a6-495e-903d-7efe411537c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54db1443-32b7-4aa1-91c9-c540abf73d26", "name": "network-vif-plugged", "status": "completed", "tag": "c51ad7a3-bf83-47f9-9860-aa5a15b5d118"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:40.979326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-0d32d17c-1b7c-4abb-acf6-e3d10d8c7548 req-5d309d6a-22a6-495e-903d-7efe411537c6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.979871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-0d32d17c-1b7c-4abb-acf6-e3d10d8c7548 req-5d309d6a-22a6-495e-903d-7efe411537c6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.996999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-0d32d17c-1b7c-4abb-acf6-e3d10d8c7548 req-5d309d6a-22a6-495e-903d-7efe411537c6 service nova] Creating event network-vif-plugged:c51ad7a3-bf83-47f9-9860-aa5a15b5d118 for instance 54db1443-32b7-4aa1-91c9-c540abf73d26 on hv-cinder-84254 May 27 15:19:41.002964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-0d32d17c-1b7c-4abb-acf6-e3d10d8c7548 req-5d309d6a-22a6-495e-903d-7efe411537c6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 May 27 15:19:41.004018 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 382/769] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:41.434594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.435119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.443102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.443551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.444301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.444766 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.576366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.583788 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8e441e04-52b7-450d-b430-4d882b216383 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.153145 May 27 15:19:41.584336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 388/770] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.607468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.608294 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.616924 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.616924 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.616924 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.616924 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.746743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.755561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.757100 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.758271 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a56a68ca-9987-4c5f-9b8c-0d8c469bf64d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.155080 May 27 15:19:41.758835 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 383/771] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:42.600548 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.601164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.607611 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.608064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.608866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.609307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.743659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.752368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f90f0a1d-0707-4b1a-856a-85e5fc77539b tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1313 microversion: 2.1 time: 0.155760 May 27 15:19:42.752963 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 389/772] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:42.777296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.777921 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.784770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.785229 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.786009 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.786453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.935266 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.943789 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.945320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.946484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9b40be31-eddf-4a44-a829-655cda434b5d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.173185 May 27 15:19:42.947044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 384/773] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:43.157738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-9db269bd-41ea-4585-9930-5cae65f0eafc req-3587929d-94ed-4162-813f-61796e744db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "name": "network-vif-plugged", "status": "completed", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:43.166007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9db269bd-41ea-4585-9930-5cae65f0eafc req-3587929d-94ed-4162-813f-61796e744db2 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.166559 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-9db269bd-41ea-4585-9930-5cae65f0eafc req-3587929d-94ed-4162-813f-61796e744db2 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.177988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-9db269bd-41ea-4585-9930-5cae65f0eafc req-3587929d-94ed-4162-813f-61796e744db2 service nova] Creating event network-vif-plugged:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:19:43.182893 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-9db269bd-41ea-4585-9930-5cae65f0eafc req-3587929d-94ed-4162-813f-61796e744db2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029475 May 27 15:19:43.183476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 390/774] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:43.769894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.770512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.777013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.777476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.778426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.778945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.909854 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.917306 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5144f8c5-3e79-4bd8-a504-5777fa83936a tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1497 microversion: 2.1 time: 0.152461 May 27 15:19:43.917871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 385/775] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:43.965658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.966396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.973266 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.973756 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.974537 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.974980 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.110970 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.119459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.120995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.122198 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c08936f3-c155-4470-810f-c83ccc072bbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.161394 May 27 15:19:44.123025 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 391/776] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:44.361496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.362084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.364198 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:44.364902 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=8 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:44.371041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.371498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.372265 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.372805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.399123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:44.431172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:44.473966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-06f50545-cb27-4f59-98cb-c3edb2cecdd3 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 204 len: 0 microversion: 2.1 time: 0.116323 May 27 15:19:44.474672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 386/777] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:19:44 2022] DELETE /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:44.483609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.484223 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.490882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.491342 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.492257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.492738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.623680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.631964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-80c37b00-5477-4fd6-b3cc-95a8d00bf6f5 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1503 microversion: 2.1 time: 0.152300 May 27 15:19:44.632580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 392/778] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.141618 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.142239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.149534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.150053 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.151063 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.151536 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.283017 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.291481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.293154 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.294324 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5201e4fb-87cc-4d54-9826-26cc96d60135 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.157198 May 27 15:19:45.294882 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 387/779] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:45.650194 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.650809 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.657738 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.658494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.659256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.659691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.789985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.808422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-82117fd1-76d6-4554-a2b1-7bcc6321d888 tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1503 microversion: 2.1 time: 0.162011 May 27 15:19:45.809442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 393/780] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.969014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1404760039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-938155760", "security_groups": [{"name": "tempest-secgroup-smoke-1722843886"}], "block_device_mapping_v2": [{"uuid": "65f66cbb-8d67-4d9a-9c7c-55783659791a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45fa6392-40e0-4a3e-b175-df35de1eff7e"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:46.093517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] validate_networks() for [('45fa6392-40e0-4a3e-b175-df35de1eff7e', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:46.312750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.314748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.321220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.321665 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.322425 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.322855 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.611487 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.619873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.621407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.622573 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-cb9e617a-ae30-4b38-9fd3-baf0ff086409 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1807 microversion: 2.20 time: 0.314212 May 27 15:19:46.623369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 394/781] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:46.637859 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:46.638440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:46.639053 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:46.639535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:46.640189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:46.650353 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.650878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.651900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.652336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.669102 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:46.673419 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for user 60ff7c679e9747898bbc44da1d885b36 and project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:46.731345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:46.733468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65f66cbb-8d67-4d9a-9c7c-55783659791a',volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:46.870538 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-6acf0ec6-dc76-4251-b5c8-ee565c7bbc40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906185 May 27 15:19:46.871367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 388/782] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:19:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:46.881716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f93de4b6-6717-4188-8a9b-53fc68f528a1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.883024 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f93de4b6-6717-4188-8a9b-53fc68f528a1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.886736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.887455 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.896078 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.896562 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.898115 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.898728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.954458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f93de4b6-6717-4188-8a9b-53fc68f528a1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.963774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f93de4b6-6717-4188-8a9b-53fc68f528a1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1094 microversion: 2.1 time: 0.085374 May 27 15:19:46.964694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 395/783] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.392468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-f15643d1-91e8-4596-9b0b-b42ecc5ba0e1 req-4460a3be-dad9-4b60-b99a-bb83636f37e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54db1443-32b7-4aa1-91c9-c540abf73d26", "name": "network-vif-deleted", "tag": "c51ad7a3-bf83-47f9-9860-aa5a15b5d118"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:47.394179 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4555cb3933ec45e687a72632857be7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca5780630fe8464a99e6afe51c9bd3e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.409043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f15643d1-91e8-4596-9b0b-b42ecc5ba0e1 req-4460a3be-dad9-4b60-b99a-bb83636f37e8 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.409592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-de291d18-59f2-4665-a266-5dfdda06bb1d tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 200 len: 1503 microversion: 2.1 time: 0.527650 May 27 15:19:47.411444 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 389/784] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.411667 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f15643d1-91e8-4596-9b0b-b42ecc5ba0e1 req-4460a3be-dad9-4b60-b99a-bb83636f37e8 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.424609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-f15643d1-91e8-4596-9b0b-b42ecc5ba0e1 req-4460a3be-dad9-4b60-b99a-bb83636f37e8 service nova] Creating event network-vif-deleted:c51ad7a3-bf83-47f9-9860-aa5a15b5d118 for instance 54db1443-32b7-4aa1-91c9-c540abf73d26 on hv-cinder-84254 May 27 15:19:47.431348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-f15643d1-91e8-4596-9b0b-b42ecc5ba0e1 req-4460a3be-dad9-4b60-b99a-bb83636f37e8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052591 May 27 15:19:47.432043 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 396/785] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:47.640916 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.642192 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.648363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.648874 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.649636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.650084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.781004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.789728 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.791414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.792666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-766a5ad7-ece3-49ff-9c52-56e505a47662 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1794 microversion: 2.20 time: 0.155863 May 27 15:19:47.793221 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 390/786] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:47.981996 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.982826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.990521 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.991128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.991979 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.992691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.086488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.096513 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88d02425-f9ce-48a6-bca7-33f6ae5b9d3d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1200 microversion: 2.1 time: 0.118648 May 27 15:19:48.097336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 397/787] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:48.427990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.428596 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] [instance: 54db1443-32b7-4aa1-91c9-c540abf73d26] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.435437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.435900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.439867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.440082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.454761 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] HTTP exception thrown: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Request method failure captured: May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 HTTP/1.1 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOvpkzfYYRER1XBgkqqAcy_n2Ycphwn-cutdZEKZjgswsw_e5e5wqJ0hWqVVXOlL7DtSnX1dozimx_SVRmBd9XlObIcaW0hBSEfCL2Un0W0WZIvGzNx5xUl91iUqOe6s8stPss9hiNqaZmQb4ixFPlAE9nPR2K3VojoXlR2duV24C9M May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: ca5780630fe8464a99e6afe51c9bd3e0 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-VolumesActionsTest-82230912 May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:19:48.456350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ca5780630fe8464a99e6afe51c9bd3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-VolumesActionsTest-82230912 May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: ca5780630fe8464a99e6afe51c9bd3e0 May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-VolumesActionsTest-82230912 May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-VolumesActionsTest-82230912-project May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 4555cb3933ec45e687a72632857be7dd May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-VolumesActionsTest-82230912-project May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. May 27 15:19:48.458002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '54db1443-32b7-4aa1-91c9-c540abf73d26'} May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:48.458922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. May 27 15:19:48.461025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:19:48.462250 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] Returning 404 to user: Instance 54db1443-32b7-4aa1-91c9-c540abf73d26 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:48.462250 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e4dfbb2d-eb21-472c-8d7f-a33654f3220c tempest-VolumesActionsTest-82230912 tempest-VolumesActionsTest-82230912-project] 10.222.0.41 "GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26" status: 404 len: 111 microversion: 2.1 time: 0.034056 May 27 15:19:48.463605 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 391/788] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/54db1443-32b7-4aa1-91c9-c540abf73d26 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:49.115244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.115865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.122560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.123021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.123797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.124236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.348994 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.356704 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5f556d4c-acfa-40e0-a1fc-99a606634261 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.245456 May 27 15:19:49.357288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 398/789] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:49.633451 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-7c9d1b3f-8c89-45c8-acbc-f1ce08dfb870 req-eb4b2163-ada6-4a64-8676-37c2f1611e18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd6a168-957b-4d55-ab12-8663ff7d32db", "tag": "8c356400-bf9a-47c2-a37f-8842fb2fb68f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:49.643045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7c9d1b3f-8c89-45c8-acbc-f1ce08dfb870 req-eb4b2163-ada6-4a64-8676-37c2f1611e18 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.643501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-7c9d1b3f-8c89-45c8-acbc-f1ce08dfb870 req-eb4b2163-ada6-4a64-8676-37c2f1611e18 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.655018 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-7c9d1b3f-8c89-45c8-acbc-f1ce08dfb870 req-eb4b2163-ada6-4a64-8676-37c2f1611e18 service nova] Creating event network-changed:8c356400-bf9a-47c2-a37f-8842fb2fb68f for instance cbd6a168-957b-4d55-ab12-8663ff7d32db on hv-cinder-84254 May 27 15:19:49.660821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-7c9d1b3f-8c89-45c8-acbc-f1ce08dfb870 req-eb4b2163-ada6-4a64-8676-37c2f1611e18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 May 27 15:19:49.661604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 392/790] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:50.374360 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.374986 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.382858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.382858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.385767 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.385767 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.530112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.538436 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-768440da-7ec8-42ba-96b3-4d252e1dc019 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.167870 May 27 15:19:50.538925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 399/791] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:51.557035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:51.557741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:51.563954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.565313 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.566084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.566532 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.697848 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.705981 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-43a9fc09-4291-4f79-a53c-bcdb78f97ab7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.153666 May 27 15:19:51.706631 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 393/792] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:51 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:52.723822 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.724427 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.730941 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.731402 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.732172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.732659 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.921432 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.930021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6eb0344d-cd25-40f8-adb0-06cbcbecf271 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.211020 May 27 15:19:52.930585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 400/793] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:53.947168 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.948440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.955627 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.956090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.956913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.957367 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.105481 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.117391 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-69f36763-b22b-4394-b2d3-3e6814795a7c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.172091 May 27 15:19:54.127195 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 394/794] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:55.134838 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.136083 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.143984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.144821 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.145852 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.146670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.330344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.338331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-15854419-5eaf-4738-89ba-c120d8645ccc tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.207536 May 27 15:19:55.340496 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 401/795] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:56.357168 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:56.358553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.366374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.367153 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.368013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.368703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.524561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.537493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-dacd7b5a-2748-4096-97f2-8829ba5ec47f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.184316 May 27 15:19:56.538158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 395/796] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:56 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:57.556020 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.557324 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.563706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:57.565127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:57.567337 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.567883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.569031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.569670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.721374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.729594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f6dcfa88-8a1a-4aa7-8cdf-8e4991ec61db tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.177574 May 27 15:19:57.739793 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 402/797] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:58.747080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.748415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.754484 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:58.755819 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:58.760244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.760741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.761541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.761987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.913027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.922691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-81f8e908-4913-4d6d-90a6-eea34c43fb4e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.179518 May 27 15:19:58.932632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 396/798] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:59.941298 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.944336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.951977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.952760 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.954041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.954928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.119259 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.127219 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f267fa65-15be-4e31-8b4f-ab0a6a20e3a6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.191805 May 27 15:20:00.137303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 403/799] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:01.146607 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.147410 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.154994 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.155634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.157335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.158035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.387125 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.398751 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e1aedb2e-e4c6-4b8d-80ba-e43cfdfb5045 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.257237 May 27 15:20:01.413900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 397/800] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:02.495189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.496526 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.504296 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.505202 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.506188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.506857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.669374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:02.683106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b7f5e501-a013-4d06-872f-362911bab29b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.191400 May 27 15:20:02.696492 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 404/801] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:03.428054 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-408d860e-4c38-4cf3-b74c-18c643057b5c req-442c3156-bbb9-4bd9-bfd4-30a2ef1e9c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd6a168-957b-4d55-ab12-8663ff7d32db", "name": "network-vif-plugged", "status": "completed", "tag": "8c356400-bf9a-47c2-a37f-8842fb2fb68f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:03.437931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:03.444438 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-408d860e-4c38-4cf3-b74c-18c643057b5c req-442c3156-bbb9-4bd9-bfd4-30a2ef1e9c95 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.445431 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-408d860e-4c38-4cf3-b74c-18c643057b5c req-442c3156-bbb9-4bd9-bfd4-30a2ef1e9c95 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.461839 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-408d860e-4c38-4cf3-b74c-18c643057b5c req-442c3156-bbb9-4bd9-bfd4-30a2ef1e9c95 service nova] Creating event network-vif-plugged:8c356400-bf9a-47c2-a37f-8842fb2fb68f for instance cbd6a168-957b-4d55-ab12-8663ff7d32db on hv-cinder-84254 May 27 15:20:03.471055 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-408d860e-4c38-4cf3-b74c-18c643057b5c req-442c3156-bbb9-4bd9-bfd4-30a2ef1e9c95 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050939 May 27 15:20:03.472501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 398/802] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:03.703430 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:03.704073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:03.712122 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.712637 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.713446 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.713896 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.955035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.963691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-23fb71f7-69d7-478b-8307-c45a0b5174ac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.264244 May 27 15:20:03.964888 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 405/803] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:03 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:04.993163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.994669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.009434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.010947 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.012911 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.014222 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.193693 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.201395 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2137c2c1-6695-43ea-8bf5-9eb74d841aba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1266 microversion: 2.1 time: 0.212957 May 27 15:20:05.202302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 399/804] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:06.221293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.223137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.231278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.231956 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.233212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.234416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.416477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.418879 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:06.427260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b42d4cbd-b69c-41b7-a89c-a6df5564c32e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1452 microversion: 2.1 time: 0.211769 May 27 15:20:06.442100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 406/805] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:06.447651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.448266 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.456204 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.456697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.457535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.457987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.615893 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.623908 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2c41056f-8a58-474e-b9a9-6730a4bfdf41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1452 microversion: 2.1 time: 0.180270 May 27 15:20:06.624709 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 400/806] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:08.744981 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-3c8e63ff-e3a0-4193-ba4b-961b67ccde09 req-15ee35ab-46c4-409f-a8c0-debb2ec222d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd6a168-957b-4d55-ab12-8663ff7d32db", "tag": "8c356400-bf9a-47c2-a37f-8842fb2fb68f"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:08.754440 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3c8e63ff-e3a0-4193-ba4b-961b67ccde09 req-15ee35ab-46c4-409f-a8c0-debb2ec222d9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.754883 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-3c8e63ff-e3a0-4193-ba4b-961b67ccde09 req-15ee35ab-46c4-409f-a8c0-debb2ec222d9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.765750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-3c8e63ff-e3a0-4193-ba4b-961b67ccde09 req-15ee35ab-46c4-409f-a8c0-debb2ec222d9 service nova] Creating event network-changed:8c356400-bf9a-47c2-a37f-8842fb2fb68f for instance cbd6a168-957b-4d55-ab12-8663ff7d32db on hv-cinder-84254 May 27 15:20:08.771377 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-3c8e63ff-e3a0-4193-ba4b-961b67ccde09 req-15ee35ab-46c4-409f-a8c0-debb2ec222d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030109 May 27 15:20:08.772315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 407/807] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:26.152341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.153136 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.154850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-77c34a32-55cc-4f94-8254-3282f66e3bb4 req-73e82066-6b5b-4109-9fea-d24ddb9a766b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:26.155566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=5 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.156336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.162751 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=11 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.162991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.163450 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.163804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.164793 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.165374 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.165541 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-77c34a32-55cc-4f94-8254-3282f66e3bb4 req-73e82066-6b5b-4109-9fea-d24ddb9a766b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.165984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-77c34a32-55cc-4f94-8254-3282f66e3bb4 req-73e82066-6b5b-4109-9fea-d24ddb9a766b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.180954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-77c34a32-55cc-4f94-8254-3282f66e3bb4 req-73e82066-6b5b-4109-9fea-d24ddb9a766b service nova] Creating event network-changed:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:20:26.188732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-77c34a32-55cc-4f94-8254-3282f66e3bb4 req-73e82066-6b5b-4109-9fea-d24ddb9a766b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035630 May 27 15:20:26.188732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 408/808] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:26.197810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:26.288198 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ef31ad50-a05a-4019-a934-502733fd74fe tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "DELETE /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 204 len: 0 microversion: 2.1 time: 0.139738 May 27 15:20:26.292507 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 401/809] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:20:26 2022] DELETE /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:20:26.299294 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.299998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.308078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.308606 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.309391 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.310064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.377752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.377752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.383085 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.383725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.384585 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.385117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.416386 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9aac313e-1035-4621-97dd-dfe88a978e5c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments/3a28a7e5-4fc4-4efd-b115-6df5de9b909b" status: 200 len: 194 microversion: 2.20 time: 0.046320 May 27 15:20:26.417229 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 402/810] 10.222.0.41 () {60 vars in 1453 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments/3a28a7e5-4fc4-4efd-b115-6df5de9b909b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:20:26.465543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:26.473580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6afe6d4e-31d8-4b62-9c1d-9c7d5942e045 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.179795 May 27 15:20:26.474367 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 409/811] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:26.484927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.485426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.492261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.492781 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.493558 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.494002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.576181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lazy-loading 'services' on Instance uuid 734d5d69-34eb-44a2-a662-0399f6fb4932 {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:26.650899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1f58ff55-bd0e-46e1-9531-abd9dfe6fda1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments/3a28a7e5-4fc4-4efd-b115-6df5de9b909b" status: 202 len: 0 microversion: 2.20 time: 0.169693 May 27 15:20:26.651506 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 403/812] 10.222.0.41 () {60 vars in 1456 bytes} [Fri May 27 15:20:26 2022] DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments/3a28a7e5-4fc4-4efd-b115-6df5de9b909b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:26.660164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.661127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.668290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.668772 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.669540 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.669972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.702234 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-1ec68841-d55e-47a7-87b4-88541159cba5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046070 May 27 15:20:26.702969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 410/813] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:27.668917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:27.669615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:27.675872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.676314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.677101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.677636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.714967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:27.715921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:27.722768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.723221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.723990 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.725065 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.754015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3ec4d93c-cb1a-4d94-a346-3a5955ec3506 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042946 May 27 15:20:27.754481 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 411/814] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:27 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:20:27.818347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:27.826113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9512b199-8d73-4843-a71a-7ab6092f3ce8 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.338573 May 27 15:20:27.826668 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 404/815] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:27 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:28.767362 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:28.768315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:28.775553 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.776006 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.776812 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.777260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.807093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c4cea39-5547-4719-ba42-9f7a5c063e66 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 May 27 15:20:28.807644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 412/816] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:28 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:20:28.843001 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:28.843610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:28.851046 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.851496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.852262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.852729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.986786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:28.994515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2701693a-051f-4eb5-9e08-0912e5417e98 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.155367 May 27 15:20:28.995063 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 405/817] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:28 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:29.819773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:29.821329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:29.827870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.828323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.829139 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.829578 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.862600 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-50eb334a-6201-4fff-b39f-821209a8f22f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047072 May 27 15:20:29.863558 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 413/818] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:29 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:30.011759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:30.012298 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:30.019255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.019715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.020534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.020981 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.156350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:30.163971 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-acbbb51c-3fc7-493c-a517-0f5967b963e4 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.156169 May 27 15:20:30.164558 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 406/819] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:30 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:30.874562 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:30.875533 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:30.882308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.882754 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.883504 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.883940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.913577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-688e5813-925e-47d3-aa4a-30c7aff1890a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042899 May 27 15:20:30.914142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 414/820] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:30 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:31.181548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:31.182180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:31.189129 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.189620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.190459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.190931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.321895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:31.329433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0fdf68ce-d463-4956-96c4-c26424ad8ca5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.152159 May 27 15:20:31.330003 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 407/821] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:31 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:31.449881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-595df824-73de-45c8-85ed-f6d362414fc4 req-6f06291b-6e96-4699-bd29-03bc787e5930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "name": "network-vif-unplugged", "status": "completed", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:31.457894 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-595df824-73de-45c8-85ed-f6d362414fc4 req-6f06291b-6e96-4699-bd29-03bc787e5930 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.458276 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-595df824-73de-45c8-85ed-f6d362414fc4 req-6f06291b-6e96-4699-bd29-03bc787e5930 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.469966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-595df824-73de-45c8-85ed-f6d362414fc4 req-6f06291b-6e96-4699-bd29-03bc787e5930 service nova] Creating event network-vif-unplugged:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:20:31.474936 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-595df824-73de-45c8-85ed-f6d362414fc4 req-6f06291b-6e96-4699-bd29-03bc787e5930 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028805 May 27 15:20:31.475528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 415/822] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:31.925542 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:31.926525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:31.932787 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.933244 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.934008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.934452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.963520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f120d442-cf35-4d4f-b6ef-c385cc1fcc42 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041978 May 27 15:20:31.964068 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 408/823] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:31 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:32.347800 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:32.348509 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:32.354632 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.355078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.355825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.356260 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.501680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:32.510768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8d84c2ac-f555-415b-af38-399d362c9067 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.167825 May 27 15:20:32.511322 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 416/824] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:32 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:32.975558 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:32.976497 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:32.983979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.984437 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.985288 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.985733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.019978 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-93b018f3-ebc6-499f-8c82-c3824620f055 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048362 May 27 15:20:33.020583 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 409/825] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:32 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:33.529862 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:33.530476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:33.537014 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.537411 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.538179 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.538618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.675188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:33.682881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7430b826-c4f4-47f9-b6f6-0699a657b0ae tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.156992 May 27 15:20:33.683445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 417/826] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:33 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:34.032362 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:34.033320 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:34.039900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.040363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.041168 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.041620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.071990 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8fac84c5-0467-4a71-b566-6bd9d393ef9f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 May 27 15:20:34.072559 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 410/827] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:34 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:34.699344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:34.699891 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:34.708158 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.709146 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.710015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.710453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.841119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.848859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4ca4c854-461d-4a47-a6af-9694815593df tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.153497 May 27 15:20:34.850046 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 418/828] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:34 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:35.083021 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.084747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.091290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.091750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.092638 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.093081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.122127 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-dc6bc188-a7f1-4db0-a67a-2b11c9c14f4c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043020 May 27 15:20:35.122963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 411/829] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:35.867840 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.868533 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.874903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.875352 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.876112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.876639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.009725 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:36.017344 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-eb88630d-b6ab-4b57-87ab-cad7938880be tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.154067 May 27 15:20:36.017895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 419/830] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:36.134115 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.135085 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.141537 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.142027 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.142810 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.143277 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.172624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2f80c495-a68f-47fa-86af-e2e3fcabf3d6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042741 May 27 15:20:36.173174 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 412/831] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:37.035502 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.036214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.043057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.043511 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.044269 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.044735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.175709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:37.184033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dc3e66c5-9511-4828-ab74-d5aa2caa3556 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.152520 May 27 15:20:37.184585 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.185064 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 420/832] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:37.185525 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.192319 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.193805 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.194299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.194735 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.223565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a28411ed-c526-428f-8029-1547b5c2ae32 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044062 May 27 15:20:37.225116 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 413/833] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:38.200494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.201100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.207478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.207921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.209462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.209965 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.235224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.236142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.242704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.243162 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.243931 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.244369 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.277201 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a34d8417-214e-463b-89d6-d20e78fb4cd2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045882 May 27 15:20:38.277768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 414/834] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:20:38.341165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:38.348878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-da3bafa6-d231-47cb-a300-2afd4cd18399 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.152205 May 27 15:20:38.350112 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 421/835] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:39.290084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.291171 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.298070 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.298514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.299287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.299729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.303828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:39.332236 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a8b4b8d5-b8b4-4759-95ac-309598dbfa10 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047311 May 27 15:20:39.332822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 415/836] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:39 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:39.366583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.367199 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.374034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.374556 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.375347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.375790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.509988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:39.517366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-26215992-7eba-4923-a15c-9405f6986f2a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.154683 May 27 15:20:39.517922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 422/837] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:39 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:40.345205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.346137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.353229 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.353682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.354451 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.354887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.384796 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b80f9a21-66d0-4528-a0b2-3ba6b26e646c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 May 27 15:20:40.385364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 416/838] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:40.535810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.536350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.544023 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.544501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.545262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.545694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.713016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:40.725697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a907483f-df27-46aa-b7ca-bd3c692c6c52 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1569 microversion: 2.1 time: 0.193706 May 27 15:20:40.726651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 423/839] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:41.245147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-3c74d747-1728-407a-a29c-6805870e2c96 req-fb9cc316-9a38-4382-bda6-d1892d10d559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131f6f40-b40d-48f7-a293-45934ec4bfbe", "name": "network-vif-deleted", "tag": "e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:41.254290 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-3c74d747-1728-407a-a29c-6805870e2c96 req-fb9cc316-9a38-4382-bda6-d1892d10d559 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.254749 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-3c74d747-1728-407a-a29c-6805870e2c96 req-fb9cc316-9a38-4382-bda6-d1892d10d559 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.267215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-3c74d747-1728-407a-a29c-6805870e2c96 req-fb9cc316-9a38-4382-bda6-d1892d10d559 service nova] Creating event network-vif-deleted:e7b6d6c9-3b9c-4870-812b-8a5f5c3534e8 for instance 131f6f40-b40d-48f7-a293-45934ec4bfbe on hv-cinder-84254 May 27 15:20:41.275573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-3c74d747-1728-407a-a29c-6805870e2c96 req-fb9cc316-9a38-4382-bda6-d1892d10d559 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 May 27 15:20:41.276132 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 417/840] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:41.395957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:41.396900 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.403113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.403881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.404378 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.404882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.441242 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9ee51b6a-ca28-4df6-bf19-76da25a5f05c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049184 May 27 15:20:41.441902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 424/841] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:20:41 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:41.503556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:41.504173 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.512145 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.512642 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.513523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.513953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.541498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:41.626592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-77ce6ae0-5663-4339-89cb-9d6ae17fbc59 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 204 len: 0 microversion: 2.20 time: 0.126856 May 27 15:20:41.627872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 418/842] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 15:20:41 2022] DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:41.635957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:41.636650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.643395 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.643780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.644603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.645046 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.744049 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:41.744789 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.751190 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.751651 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.752464 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.752916 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.776594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.780309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=100 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:41.785603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.787876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.789100 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.789226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ad824078-2327-4d47-83b8-9d49dc26d74a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.156987 May 27 15:20:41.789546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.789768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 425/843] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:41 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:41.790005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lazy-loading 'fault' on Instance uuid 131f6f40-b40d-48f7-a293-45934ec4bfbe {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:41.831554 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.839207 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-31a87ffc-0944-440a-8064-536402a80bd5 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1224 microversion: 2.1 time: 0.100515 May 27 15:20:41.839774 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 419/844] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:41 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:42.809193 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:42.809814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:42.816285 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.816778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.817569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.818700 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.857165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:42.857891 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:42.865236 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.865948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.866739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.867189 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.899264 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.899718 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.900172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.objects.instance [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lazy-loading 'fault' on Instance uuid 131f6f40-b40d-48f7-a293-45934ec4bfbe {{(pid=117641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:42.954909 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7eb6c795964aaa92e7f1fd3993a29c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32fb068c248a4cb9bb0e73dab923ca19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:42.962956 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-693266c3-d0f9-44fb-b981-d67bea556d1a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 200 len: 1224 microversion: 2.1 time: 0.109668 May 27 15:20:42.963688 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 420/845] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:42 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:42.976040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:42.983940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:42.985483 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:42.986651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a48408ba-8656-4062-8f88-e1f68a37fa22 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.181643 May 27 15:20:42.987274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 426/846] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:42 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:43.979607 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:43.980414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] [instance: 131f6f40-b40d-48f7-a293-45934ec4bfbe] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:43.986873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:43.987340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:43.988120 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:43.988598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.003295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] HTTP exception thrown: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Request method failure captured: May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe HTTP/1.1 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOsFicq6DQxZAXMriDn_FrbTnSEChdwuuFhSqI1ggl4KVJTUqyNALP6dyLDK_faD_r6-ahxe-IL9tFP7TfOyShr6JF2ZcfpX-JScUB13gLeu8lbVHKLCI2s5o9BZlKVKYry-8aiw0Gjpff4LWvJ4tK0FllvHlZ-AAzWjbLJ99tw_qGw May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 32fb068c248a4cb9bb0e73dab923ca19 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestShelveInstance-1476086756 May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:20:44.005625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/32fb068c248a4cb9bb0e73dab923ca19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/32fb068c248a4cb9bb0e73dab923ca19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_32fb068c248a4cb9bb0e73dab923ca19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/32fb068c248a4cb9bb0e73dab923ca19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestShelveInstance-1476086756 May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 32fb068c248a4cb9bb0e73dab923ca19 May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestShelveInstance-1476086756 May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestShelveInstance-1476086756-project May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 3b7eb6c795964aaa92e7f1fd3993a29c May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestShelveInstance-1476086756-project May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. May 27 15:20:44.007516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '131f6f40-b40d-48f7-a293-45934ec4bfbe'} May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:44.008549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. May 27 15:20:44.010600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:44.012039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:44.012039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:44.012737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Returning 404 to user: Instance 131f6f40-b40d-48f7-a293-45934ec4bfbe could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:44.012737 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3ac873e6-3228-40df-b78d-81ef794ecd78 tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe" status: 404 len: 111 microversion: 2.1 time: 0.034885 May 27 15:20:44.013207 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 421/847] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:43 2022] GET /compute/v2.1/servers/131f6f40-b40d-48f7-a293-45934ec4bfbe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:44.013706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.014178 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.014968 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.015500 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.221645 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.231153 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.233224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.234646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b630f09f-18fb-40f2-8b35-59546a950cf1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 200 len: 1722 microversion: 2.20 time: 0.233203 May 27 15:20:44.235372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 427/848] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:44 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:44.263936 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-92d3eb31-7fc8-4820-9b50-1a23f130b07a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] Calling method '.version_select at 0x7fa372586160>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:44.298071 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-92d3eb31-7fc8-4820-9b50-1a23f130b07a tempest-TestShelveInstance-1476086756 tempest-TestShelveInstance-1476086756-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-464767388" status: 202 len: 0 microversion: 2.1 time: 0.037832 May 27 15:20:44.308343 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 422/849] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 15:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-464767388 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:44.619627 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-1e8b04aa-3067-40e2-b91a-d30f8d84ef50 req-be6dfd4a-5bc4-4176-bf42-2abdb8d076fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5d69-34eb-44a2-a662-0399f6fb4932", "name": "network-vif-deleted", "tag": "3d45f8fd-c388-4bad-9229-622e4309da14"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:44.633120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-1e8b04aa-3067-40e2-b91a-d30f8d84ef50 req-be6dfd4a-5bc4-4176-bf42-2abdb8d076fe service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.633892 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-1e8b04aa-3067-40e2-b91a-d30f8d84ef50 req-be6dfd4a-5bc4-4176-bf42-2abdb8d076fe service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.650567 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-1e8b04aa-3067-40e2-b91a-d30f8d84ef50 req-be6dfd4a-5bc4-4176-bf42-2abdb8d076fe service nova] Creating event network-vif-deleted:3d45f8fd-c388-4bad-9229-622e4309da14 for instance 734d5d69-34eb-44a2-a662-0399f6fb4932 on hv-cinder-84254 May 27 15:20:44.671592 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-1e8b04aa-3067-40e2-b91a-d30f8d84ef50 req-be6dfd4a-5bc4-4176-bf42-2abdb8d076fe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042485 May 27 15:20:44.673114 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 428/850] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:45.254121 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:45.254724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:45.264624 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.265081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.266055 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.266497 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.281877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 HTTP/1.1 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:20:45.283457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:20:45.284920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '734d5d69-34eb-44a2-a662-0399f6fb4932'} May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:45.285710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:20:45.287634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:20:45.288975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:45.288975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-5a23e43b-27d3-4873-aec1-b21802556935 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 404 len: 111 microversion: 2.20 time: 0.035414 May 27 15:20:45.288975 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 423/851] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:45 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:20:45.295570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff2a9926-777b-4518-b684-4c855da96e27 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '.version_select at 0x7fa371cd6280>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:45.315774 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff2a9926-777b-4518-b684-4c855da96e27 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167098453" status: 204 len: 0 microversion: 2.20 time: 0.024698 May 27 15:20:45.316346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 429/852] 10.222.0.41 () {60 vars in 1261 bytes} [Fri May 27 15:20:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167098453 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:46.077879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-68f843a9-52c0-4c37-ad19-6bcfa782d84a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: .version_select at 0x7fa3726c9700>, body: {"keypair": {"name": "tempest-keypair-889393898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1Mha9BOk2ML7kQ5aKnnZJB4aEpacHW2F99uc9+zAZjeN8Dukk0E048jyCffgPqozofbTM25ye1eGKBIKK+G7YtZjorktmAI901FvRH1f3x1Wi+TJfPmjJZXN20k9D4lg=="}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:46.092377 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-68f843a9-52c0-4c37-ad19-6bcfa782d84a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:46.097280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-68f843a9-52c0-4c37-ad19-6bcfa782d84a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for user 973c068eff44436785ddf19a6465da8f and project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'key_pairs'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:46.127084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-68f843a9-52c0-4c37-ad19-6bcfa782d84a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052982 May 27 15:20:46.128516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 424/853] 10.222.0.41 () {62 vars in 1199 bytes} [Fri May 27 15:20:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:20:47.891474 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2044713543", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bae1b8f-6527-43a2-8c28-4f4a1470a167"}], "security_groups": [{"name": "tempest-securitygroup--1316325345"}], "key_name": "tempest-keypair-889393898", "user_data": "}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:48.081622 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] validate_networks() for [('7bae1b8f-6527-43a2-8c28-4f4a1470a167', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:49.176318 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:49.177996 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:49.178783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:49.179368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:49.179961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:49.194810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.195631 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.199270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.200007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.243579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:49.254765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Getting quotas for user 973c068eff44436785ddf19a6465da8f and project 80d48e2adc1e4c6ebfdd43e84f8e3106. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:49.272078 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:49.283144 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:49.354323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-084c011a-2c44-463c-973f-d71a0f6ea5a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.467031 May 27 15:20:49.355972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 430/854] 10.222.0.41 () {62 vars in 1187 bytes} [Fri May 27 15:20:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 27 15:20:49.366682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:49.367333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:49.464920 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.479615 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.481342 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.482598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-87935225-91f3-486a-868b-92fc44009773 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1281 microversion: 2.20 time: 0.120864 May 27 15:20:49.484491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 425/855] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:49 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:50.509111 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:50.510459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:50.520303 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.521127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.522657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.523108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.650438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:50.665897 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:50.667532 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:50.668707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-157eff18-2b7d-4baf-bed8-ea5ddbd39676 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1339 microversion: 2.20 time: 0.169003 May 27 15:20:50.680480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 431/856] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:50 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:50.824352 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-466474146", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "networks": [{"uuid": "031e6226-4ab9-4c38-ae21-400eb45fd11f"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:50.893877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] validate_networks() for [('031e6226-4ab9-4c38-ae21-400eb45fd11f', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:51.689314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.690825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.699484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.699942 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.700948 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.702092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.714816 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:51.716050 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:51.716871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:51.717500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:51.718124 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:51.734617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.735450 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.736683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.739209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.761203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Getting quotas for project be77db463e844d0a8078b9fd07b7a968. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:51.765927 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Getting quotas for user 2c0fe34091fa457ba6a20f6d0b9fb016 and project be77db463e844d0a8078b9fd07b7a968. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:51.779274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:51.782148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:51.832762 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1b27f92a-0502-4274-b5ea-bd1302ac7f91 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012055 May 27 15:20:51.835048 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 426/857] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:51.845534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-2ef93a57-bd81-43ba-9a79-ac854d84efd9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.846685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-2ef93a57-bd81-43ba-9a79-ac854d84efd9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.862345 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:51.935887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-2ef93a57-bd81-43ba-9a79-ac854d84efd9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:51.947280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-2ef93a57-bd81-43ba-9a79-ac854d84efd9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1218 microversion: 2.1 time: 0.106307 May 27 15:20:51.948301 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 427/858] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:51 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:51.990608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.007518 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.012918 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.014076 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b442179a-afc6-4a2e-983f-e979931a5df6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.330513 May 27 15:20:52.024118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 432/859] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:51 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:52.610240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-75bb77c0-6c1b-4992-884a-26139e22572f req-aa78ccc5-3cd3-4b03-95e0-ce6d6755f4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:52.643144 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-75bb77c0-6c1b-4992-884a-26139e22572f req-aa78ccc5-3cd3-4b03-95e0-ce6d6755f4eb service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.643650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-75bb77c0-6c1b-4992-884a-26139e22572f req-aa78ccc5-3cd3-4b03-95e0-ce6d6755f4eb service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.666142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-75bb77c0-6c1b-4992-884a-26139e22572f req-aa78ccc5-3cd3-4b03-95e0-ce6d6755f4eb service nova] Creating event network-changed:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:20:52.683571 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-75bb77c0-6c1b-4992-884a-26139e22572f req-aa78ccc5-3cd3-4b03-95e0-ce6d6755f4eb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078811 May 27 15:20:52.687303 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 428/860] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:52.964733 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:52.965346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.972002 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.972479 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.973278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.973747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.032935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.043811 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.048036 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.051737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c8e738a8-b6ad-4e1d-bd71-2e2cda492c74 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1270 microversion: 2.1 time: 0.090832 May 27 15:20:53.053164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 433/861] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:52 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:53.059357 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.060137 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.061517 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.063752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.342058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.351381 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.353326 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.354509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e1a928ee-153a-44cd-adaa-824c4e1791cb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.326953 May 27 15:20:53.355058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 429/862] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:53 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:54.069150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:54.069758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:54.076274 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.076763 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.077517 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.077957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.250404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.265399 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bd3947ef-fe5a-4a6e-93df-6feedd0f7cca tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.199042 May 27 15:20:54.266689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 434/863] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:54 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:54.378256 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:54.379578 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:54.394889 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.396839 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.397924 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.398600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.884747 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.892943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.894407 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.895548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c1d6df4f-b348-4588-b721-cc123d6d4929 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.525794 May 27 15:20:54.896117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 430/864] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:54 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:55.228972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-f666bfce-fe94-4a3d-9104-25499041a1e5 req-514a889a-af7b-4daf-9005-4090e9c87ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9c1d07-b959-4f07-ab32-ff428177b35b", "tag": "2bf5db6f-f925-4da6-88ba-6a3a1549164b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:55.240229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f666bfce-fe94-4a3d-9104-25499041a1e5 req-514a889a-af7b-4daf-9005-4090e9c87ba1 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.240908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-f666bfce-fe94-4a3d-9104-25499041a1e5 req-514a889a-af7b-4daf-9005-4090e9c87ba1 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.253129 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-f666bfce-fe94-4a3d-9104-25499041a1e5 req-514a889a-af7b-4daf-9005-4090e9c87ba1 service nova] Creating event network-changed:2bf5db6f-f925-4da6-88ba-6a3a1549164b for instance ec9c1d07-b959-4f07-ab32-ff428177b35b on hv-cinder-84254 May 27 15:20:55.259577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-f666bfce-fe94-4a3d-9104-25499041a1e5 req-514a889a-af7b-4daf-9005-4090e9c87ba1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 May 27 15:20:55.260181 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 435/865] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:55.283827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:55.284725 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:55.291729 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.292276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.293185 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.293702 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.547768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:55.556825 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-97cf1912-6f6c-4663-9c3f-8cfab200df07 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.277213 May 27 15:20:55.557666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 431/866] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:55 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:55.914777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:55.915480 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:55.921715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.922168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.922945 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.923383 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.062271 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.071060 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.072648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.073763 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff1c978a-99c2-44d6-bbcd-4ab019e13c7e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.164165 May 27 15:20:56.074320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 436/867] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:55 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:56.574076 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:56.574702 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:56.581191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.581647 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.582426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.582869 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.790453 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.797938 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d3fd9d93-6001-4442-b372-3d3aa318fd31 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.227757 May 27 15:20:56.798508 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 432/868] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:56 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:57.091880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:57.092560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:57.095179 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:57.100390 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.100874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.101640 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.102110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.235826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:57.244672 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:57.246185 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:57.247293 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e92b6689-f573-467b-9c9a-9642d098e5ec tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.159508 May 27 15:20:57.247840 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 437/869] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:57 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:57.753682 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-b8c9c659-8308-47aa-8295-44d71d1cf6d5 req-df9d3111-4d8b-4fd0-a824-0574b1903707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "name": "network-vif-plugged", "status": "completed", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:57.762885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b8c9c659-8308-47aa-8295-44d71d1cf6d5 req-df9d3111-4d8b-4fd0-a824-0574b1903707 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.763336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b8c9c659-8308-47aa-8295-44d71d1cf6d5 req-df9d3111-4d8b-4fd0-a824-0574b1903707 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.775643 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-b8c9c659-8308-47aa-8295-44d71d1cf6d5 req-df9d3111-4d8b-4fd0-a824-0574b1903707 service nova] Creating event network-vif-plugged:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:20:57.780661 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-b8c9c659-8308-47aa-8295-44d71d1cf6d5 req-df9d3111-4d8b-4fd0-a824-0574b1903707 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 May 27 15:20:57.781325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 433/870] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:57.815890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:57.817551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:57.824246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.824731 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.826278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.826750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.024281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:58.033143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-dd2e1375-d918-480e-8ad1-9403993c73ae tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.221599 May 27 15:20:58.034616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 438/871] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:57 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:58.267750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:58.268361 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:58.275900 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.276351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.278148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.278591 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.412697 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:58.420689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:58.422214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:58.423331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-38c53974-623c-46f8-9533-32c7ee445127 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.159921 May 27 15:20:58.423913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 434/872] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:58 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:59.050263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:59.050878 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:59.058131 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.058583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.059357 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.059797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.189680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.197336 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f097d00d-c79d-4aa6-af57-0bf8560c997f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.151049 May 27 15:20:59.197889 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 439/873] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:20:59 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:59.441653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:59.442421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:59.448980 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.449434 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.450209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.450653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.597704 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.607073 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.608618 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.609961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3bb39557-021e-447b-923a-e2e7bf3c6408 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1407 microversion: 2.20 time: 0.172309 May 27 15:20:59.610877 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 435/874] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:20:59 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:59.795594 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-88eb61b5-d243-4ca7-8e36-7fa873cf2a23 req-439b428e-e370-467d-8262-038de6e83bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9c1d07-b959-4f07-ab32-ff428177b35b", "name": "network-vif-plugged", "status": "completed", "tag": "2bf5db6f-f925-4da6-88ba-6a3a1549164b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:59.798996 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:59.799680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:59.806560 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-88eb61b5-d243-4ca7-8e36-7fa873cf2a23 req-439b428e-e370-467d-8262-038de6e83bc0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.807007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-88eb61b5-d243-4ca7-8e36-7fa873cf2a23 req-439b428e-e370-467d-8262-038de6e83bc0 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.817985 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-88eb61b5-d243-4ca7-8e36-7fa873cf2a23 req-439b428e-e370-467d-8262-038de6e83bc0 service nova] Creating event network-vif-plugged:2bf5db6f-f925-4da6-88ba-6a3a1549164b for instance ec9c1d07-b959-4f07-ab32-ff428177b35b on hv-cinder-84254 May 27 15:20:59.822735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-88eb61b5-d243-4ca7-8e36-7fa873cf2a23 req-439b428e-e370-467d-8262-038de6e83bc0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 May 27 15:20:59.823297 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 440/875] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:00.214381 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.214995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.221139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.221594 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.222383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.222818 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.353724 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.361477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4d36cf33-c5ea-4a16-afc5-7bddfbbc85f5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.151491 May 27 15:21:00.362037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 436/876] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:00.628209 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.628988 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.636050 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.636538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.637306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.637747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.771552 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.779850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.781513 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.782697 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a751c135-d510-4c74-baaa-a73316cdda28 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1597 microversion: 2.20 time: 0.159291 May 27 15:21:00.783251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 441/877] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:00.800205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.800785 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.807540 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.808000 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.808849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.809339 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.828012 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:00.899214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d3d6c54c-81ed-4434-b6fb-1e1ccdc5c728 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103085 May 27 15:21:00.899873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 437/878] 10.222.0.41 () {60 vars in 1315 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:21:01.378794 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:01.379408 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:01.386037 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.386485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.387324 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.387721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.619142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:01.628747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-699cdaf9-01a8-44b9-8684-3a2e37834aa9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1318 microversion: 2.1 time: 0.253774 May 27 15:21:01.630389 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 442/879] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:01 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:01.827240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:01.832183 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-57a2b0a4-eaca-4155-acac-97ef54a51fc5 req-33fb61d0-301c-4281-99d2-e2b03995db39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:01.841752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-57a2b0a4-eaca-4155-acac-97ef54a51fc5 req-33fb61d0-301c-4281-99d2-e2b03995db39 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.842287 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-57a2b0a4-eaca-4155-acac-97ef54a51fc5 req-33fb61d0-301c-4281-99d2-e2b03995db39 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.854997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-57a2b0a4-eaca-4155-acac-97ef54a51fc5 req-33fb61d0-301c-4281-99d2-e2b03995db39 service nova] Creating event network-changed:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:21:01.860962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-57a2b0a4-eaca-4155-acac-97ef54a51fc5 req-33fb61d0-301c-4281-99d2-e2b03995db39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 May 27 15:21:01.861598 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 438/880] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:02.647061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:02.647608 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:02.654265 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.654716 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.655485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.655949 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.790909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:02.798365 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8bd58da9-d8ab-49ea-bffc-ea071cd7ca66 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1508 microversion: 2.1 time: 0.156008 May 27 15:21:02.798932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 443/881] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:02 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:16.877255 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=14 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.878646 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=22 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.879314 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.884478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bd906cb-6796-40f8-914d-7a627eb8604c", "device": "/dev/sdb"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:16.886123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.893347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.893802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.894565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.895004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:17.129239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c3f7c8c5-08d3-4ab2-ba9b-ce71618b889c tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "POST /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252234 May 27 15:21:17.129847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 439/882] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:21:16 2022] POST /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:39.902737 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:39.903262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:39.905763 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=13 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:39.906589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=86 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:39.912703 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.913156 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.913958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.914405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.996001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lazy-loading 'services' on Instance uuid ec9c1d07-b959-4f07-ab32-ff428177b35b {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:40.072718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0d0274c7-bcd4-44f1-ad35-896d2437657f tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b/os-volume_attachments/9bd906cb-6796-40f8-914d-7a627eb8604c" status: 202 len: 0 microversion: 2.1 time: 0.174413 May 27 15:21:40.074046 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 444/883] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:21:39 2022] DELETE /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b/os-volume_attachments/9bd906cb-6796-40f8-914d-7a627eb8604c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:41.188710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:41.189299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:41.191770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:41.192622 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:41.199416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.199873 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.200679 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.201122 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.230732 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:41.307948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0ee0922a-7c46-4a77-bbee-c9b1bacc4ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 204 len: 0 microversion: 2.1 time: 0.123418 May 27 15:21:41.308577 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 440/884] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:21:41 2022] DELETE /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:41.317291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:41.318634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:41.325193 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.325655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.326427 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.326871 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.462773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.471077 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2c076fb7-549d-4d57-bc1c-75e0143b3231 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1514 microversion: 2.1 time: 0.158009 May 27 15:21:41.471630 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 445/885] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:41 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:42.488415 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:42.489139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:42.496698 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.497148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.497910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.498349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.628073 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.636210 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-8f71d27a-a6d6-4834-acca-b0859b1fd955 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1514 microversion: 2.1 time: 0.151956 May 27 15:21:42.636832 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 441/886] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:42 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:43.653454 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:43.654177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:43.662127 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.662588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.664282 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.664778 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.735625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-b423054f-66f0-48bc-90d5-ac6e43c7ba4f req-882fc362-4fd2-42ae-b986-66cbe597300c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9c1d07-b959-4f07-ab32-ff428177b35b", "name": "network-vif-deleted", "tag": "2bf5db6f-f925-4da6-88ba-6a3a1549164b"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:43.747933 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b423054f-66f0-48bc-90d5-ac6e43c7ba4f req-882fc362-4fd2-42ae-b986-66cbe597300c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.751107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:43.754866 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b423054f-66f0-48bc-90d5-ac6e43c7ba4f req-882fc362-4fd2-42ae-b986-66cbe597300c service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.765421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5a5c5981-c4c0-49dd-8b07-87f2c51288f2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 200 len: 1472 microversion: 2.1 time: 0.116728 May 27 15:21:43.765992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 446/887] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:43 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 1472 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:43.771223 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-b423054f-66f0-48bc-90d5-ac6e43c7ba4f req-882fc362-4fd2-42ae-b986-66cbe597300c service nova] Creating event network-vif-deleted:2bf5db6f-f925-4da6-88ba-6a3a1549164b for instance ec9c1d07-b959-4f07-ab32-ff428177b35b on hv-cinder-84254 May 27 15:21:43.776064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-b423054f-66f0-48bc-90d5-ac6e43c7ba4f req-882fc362-4fd2-42ae-b986-66cbe597300c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044361 May 27 15:21:43.777426 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 442/888] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:44.783186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:44.783713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: ec9c1d07-b959-4f07-ab32-ff428177b35b] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:44.790086 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.790529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.791273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.791703 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.804972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] HTTP exception thrown: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Request method failure captured: May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b HTTP/1.1 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOxRVzCE6hdfWnSQsIH45rtKk6rHRzTkBQH6WiBAmuUt07IhiGVbNc105XukGEDIA_BYHkTpr2vsQQjGKqkZXScrY9ducwD3ZbQQo_rv8cFDy9TCkDPGMwrp8_k6AXaS7rPNwq_t54T9BgSFT0eOzqh2198rsSK_k2MSgsXzHK31_ZI May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: be77db463e844d0a8078b9fd07b7a968 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:21:44.806654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: be77db463e844d0a8078b9fd07b7a968 May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-1240087653-project May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 2c0fe34091fa457ba6a20f6d0b9fb016 May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1240087653-project May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. May 27 15:21:44.808819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'ec9c1d07-b959-4f07-ab32-ff428177b35b'} May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:44.809694 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. May 27 15:21:44.811284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:21:44.812690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Returning 404 to user: Instance ec9c1d07-b959-4f07-ab32-ff428177b35b could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:44.812690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3a69cff2-b9f6-4e17-a01d-3604a797c438 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b" status: 404 len: 111 microversion: 2.1 time: 0.029312 May 27 15:21:44.812690 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 447/889] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:44 2022] GET /compute/v2.1/servers/ec9c1d07-b959-4f07-ab32-ff428177b35b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:52.558683 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:52.559276 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:52.565478 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.565935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.566714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.567158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.591788 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f595c74f-79ee-453b-a35f-eac3c0d63f8d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/ips" status: 200 len: 149 microversion: 2.20 time: 0.038154 May 27 15:21:52.592347 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 443/890] 10.222.0.41 () {60 vars in 1288 bytes} [Fri May 27 15:21:52 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:21:53.641712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1047684268", "imageRef": "123927d5-bea3-415f-bc7d-b49882f8dd51", "flavorRef": "452", "networks": [{"uuid": "031e6226-4ab9-4c38-ae21-400eb45fd11f"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:53.693606 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] validate_networks() for [('031e6226-4ab9-4c38-ae21-400eb45fd11f', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:21:54.044410 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:21:54.044866 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:21:54.045368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:21:54.045777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:21:54.046220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:21:54.055095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.055569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.056370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.056832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.073655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Getting quotas for project be77db463e844d0a8078b9fd07b7a968. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:21:54.077534 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Getting quotas for user 2c0fe34091fa457ba6a20f6d0b9fb016 and project be77db463e844d0a8078b9fd07b7a968. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:21:54.088053 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:21:54.090439 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='123927d5-bea3-415f-bc7d-b49882f8dd51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:21:54.136108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-05c0700c-b194-4b36-86a0-05e64ebba6d4 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497722 May 27 15:21:54.136984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 448/891] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:21:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:21:54.146659 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f2915ac4-53bf-44bc-9162-5773fbe526e5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.147305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f2915ac4-53bf-44bc-9162-5773fbe526e5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.204926 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f2915ac4-53bf-44bc-9162-5773fbe526e5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.211664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f2915ac4-53bf-44bc-9162-5773fbe526e5 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1219 microversion: 2.1 time: 0.068832 May 27 15:21:54.212247 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 444/892] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:54.603596 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:54.604270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.610968 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.611423 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.612191 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.612658 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.636122 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lazy-loading 'flavor' on Instance uuid 8632102f-28fe-4b73-bd34-b51fc1c3179c {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:54.893854 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-639137cb-e963-437c-b5ef-177058013d1f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/action" status: 202 len: 0 microversion: 2.20 time: 0.294287 May 27 15:21:54.894580 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 449/893] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 15:21:54 2022] POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:54.903252 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.903868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.909901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.910359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.911128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.911570 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.051165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.059996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.061546 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.062722 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-bba27ecf-59d3-44dd-ad8c-f4a1a8c3b87c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.164174 May 27 15:21:55.063282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 445/894] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:55.231100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:55.231810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:55.238237 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.238646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.239673 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.240051 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.331954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.339552 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-145e747a-55c0-41e8-a417-745bb55dc601 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1277 microversion: 2.1 time: 0.113451 May 27 15:21:55.340107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 450/895] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:55 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:56.082211 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:56.082836 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:56.089626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.090082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.090892 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.091363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.287987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.297322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.298893 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.300139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-814cf230-6da0-4324-8aaf-24932f743046 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.221970 May 27 15:21:56.300733 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 446/896] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:56 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:21:56.357527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:56.358082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:56.364784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.365242 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.366019 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.366462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.573449 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.581041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68834acd-c47e-4fbb-9c62-92fa5a1eb084 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.228240 May 27 15:21:56.581601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 451/897] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:56 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:56.655436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-6e1315c1-d9a4-47aa-a7dc-13eb7c3ca58e req-0cf7282d-2b8d-46ff-b2f1-9dd6f2671050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ced399-f5f9-4d5b-800d-6f6dfc86fdd6", "tag": "eec3b38f-cd0e-4e34-97d0-1afc972d7b2b"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:56.663844 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-6e1315c1-d9a4-47aa-a7dc-13eb7c3ca58e req-0cf7282d-2b8d-46ff-b2f1-9dd6f2671050 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.674503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-6e1315c1-d9a4-47aa-a7dc-13eb7c3ca58e req-0cf7282d-2b8d-46ff-b2f1-9dd6f2671050 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.688158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-6e1315c1-d9a4-47aa-a7dc-13eb7c3ca58e req-0cf7282d-2b8d-46ff-b2f1-9dd6f2671050 service nova] Creating event network-changed:eec3b38f-cd0e-4e34-97d0-1afc972d7b2b for instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 on hv-cinder-84254 May 27 15:21:56.693781 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-6e1315c1-d9a4-47aa-a7dc-13eb7c3ca58e req-0cf7282d-2b8d-46ff-b2f1-9dd6f2671050 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043873 May 27 15:21:56.694388 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 447/898] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:57.319188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.319790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.327033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.327487 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.328259 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.328726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.459335 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.467270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.468814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.469977 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2b4d6f80-af3e-4f2f-a2eb-c18479f8f68b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.154748 May 27 15:21:57.470777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 452/899] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:57.598999 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.599625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.607010 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.607457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.608231 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.608714 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.742503 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.750666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-db018b06-b748-44c2-900a-6c3149e52301 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.156162 May 27 15:21:57.751228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 448/900] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:58.488857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.489477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.496236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.496741 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.497532 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.497969 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.767588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.768182 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.774664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.775118 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.775947 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.776700 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.878485 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.887306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.888880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.890089 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c7001ce8-100f-4a25-a035-64baa9f4de54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.405267 May 27 15:21:58.890646 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 453/901] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:58.923059 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.930499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-06a815ba-d2b5-4850-a68a-c27999605ecd tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.166781 May 27 15:21:58.931058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 449/902] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:59.908613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.909246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.915647 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.916121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.917196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.917663 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.947139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.948263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.955234 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.955693 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.956496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.956942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.108018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.115992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.117525 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.118691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9312001f-bba8-4fe9-b6d6-9a407821de3c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.214319 May 27 15:22:00.125523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 454/903] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:00.141534 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.148991 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fc51a849-2689-4f18-8115-83287472bbb9 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.205769 May 27 15:22:00.149560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 450/904] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:01.138177 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:01.138718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:01.145142 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.145587 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.146335 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.146768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.166080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:01.166698 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:01.173219 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.173691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.174458 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.174901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.319742 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.328924 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.330451 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.331735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6c01e5af-3a43-4279-85ea-f4d51693230b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.198533 May 27 15:22:01.332179 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 455/905] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:01 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:01.378918 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.386783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b591ccce-a197-45f3-b70b-0484c07ce44d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.224465 May 27 15:22:01.387355 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 451/906] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:01 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:02.115907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-c6b3fe20-cbee-4098-8cae-81b0b7fbf45f req-23e55a70-6fb6-4f5d-85a6-7a80b2ead220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ced399-f5f9-4d5b-800d-6f6dfc86fdd6", "name": "network-vif-plugged", "status": "completed", "tag": "eec3b38f-cd0e-4e34-97d0-1afc972d7b2b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:02.128712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c6b3fe20-cbee-4098-8cae-81b0b7fbf45f req-23e55a70-6fb6-4f5d-85a6-7a80b2ead220 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.129256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-c6b3fe20-cbee-4098-8cae-81b0b7fbf45f req-23e55a70-6fb6-4f5d-85a6-7a80b2ead220 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.143182 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-c6b3fe20-cbee-4098-8cae-81b0b7fbf45f req-23e55a70-6fb6-4f5d-85a6-7a80b2ead220 service nova] Creating event network-vif-plugged:eec3b38f-cd0e-4e34-97d0-1afc972d7b2b for instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 on hv-cinder-84254 May 27 15:22:02.148267 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-c6b3fe20-cbee-4098-8cae-81b0b7fbf45f req-23e55a70-6fb6-4f5d-85a6-7a80b2ead220 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039021 May 27 15:22:02.149768 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 456/907] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:02.350377 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:02.350993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:02.357760 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.358213 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.359346 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.359794 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.404520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:02.405341 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:02.411589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.412111 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.412907 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.413345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.545993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.554515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.556023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.557233 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-d090909d-f6ac-4ac7-82fc-e1c4ce744de3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.210913 May 27 15:22:02.558881 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 452/908] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:02 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:02.575268 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.582628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-530eb2e1-a9b4-4a28-9e6b-72b5343c132d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.183047 May 27 15:22:02.583125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 457/909] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:02 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:03.576077 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:03.576738 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:03.583293 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.583744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.584554 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.584996 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.599501 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:03.600175 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:03.607753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.608201 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.609014 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.609478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.788549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.795908 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.797477 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.799004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.800186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-80f880c0-79b6-4232-9e51-547f7a6eedbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.228772 May 27 15:22:03.800801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 453/910] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:03 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:03.803456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e09bf98-fc2a-464a-b1b2-189287de7d44 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1319 microversion: 2.1 time: 0.208034 May 27 15:22:03.804005 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 458/911] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:03 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:04.819333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:04.819948 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:04.820730 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:04.821347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:04.821894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:04.823428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:04.824196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=6 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:04.828782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.829234 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.830006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.830441 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.830801 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.831258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.832031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.832494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.032930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.036265 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:05.038489 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.044249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-20d4768d-052a-47e3-8af0-2664e9dc11e2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1508 microversion: 2.1 time: 0.227273 May 27 15:22:05.045047 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 459/912] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:05.052815 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.054332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.055660 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4269ab13-b042-4da6-8d2f-0d06710862e0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.240381 May 27 15:22:05.056351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 454/913] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:05.061517 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec7b7112-013b-4fe2-bfc3-158cecfd778a", "device": "/dev/sdb"}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:05.063256 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.069915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.070634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.071278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.071719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.706740 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-23c75902-cf98-4f90-bd9d-84e763b022b2 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "POST /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649359 May 27 15:22:05.707346 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 460/914] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 15:22:05 2022] POST /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:06.074753 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:06.075364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:06.081743 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:06.082194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:06.082953 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:06.083390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:06.218802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:06.227157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:06.228723 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:06.229895 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e64e09d2-8c23-4222-8b9e-0c339851d125 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.159898 May 27 15:22:06.230492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 455/915] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:06 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:07.248196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:07.248959 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:07.255528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.256102 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.257073 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.257579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.390057 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:07.398023 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:07.399529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:07.400711 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9ae7e575-d97d-471d-a9bf-93adabcb18d2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.157364 May 27 15:22:07.401967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 461/916] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:07 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:08.420019 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:08.420759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:08.427282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.427745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.428556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.429006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.556344 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.564349 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.565893 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.567057 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3c0b5f1a-0585-4015-90a8-842db4e51f14 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.151693 May 27 15:22:08.567610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 456/917] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:08 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:09.585632 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:09.586277 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:09.592856 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.593310 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:09.594079 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.594523 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:09.726851 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.735373 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.736922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.738081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f964bf1c-f042-4791-88d7-6a3c7680f89f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.156381 May 27 15:22:09.738633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 462/918] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:09 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:10.755814 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:10.756385 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:10.763163 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:10.763618 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:10.764389 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:10.764862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:10.783286 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:10.896951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.905669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.907176 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.908341 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-cbc16073-53d2-413f-8821-36662c7f361f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.156740 May 27 15:22:10.908937 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 457/919] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:10 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:11.926585 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:11.927196 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:11.929677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:11.936039 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.936519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.937287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.937718 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:12.071047 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.078984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.080568 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.081767 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-88b9118b-def4-4724-8778-f1ede3d9798c tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.159276 May 27 15:22:12.082674 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 463/920] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:11 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:13.100961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:13.101588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:13.103898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:13.109373 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.109824 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.110601 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.111041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.247239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:13.257064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:13.258645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:13.259821 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a7e7a16d-339f-4d9d-b2d8-f6d29d582ae2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.162814 May 27 15:22:13.260925 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 458/921] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:13 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:14.279128 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:14.279699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:14.286159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.286606 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.287374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.287814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.416890 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.424810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.426317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.427470 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-67221fbd-c263-4c79-80d5-4e56f1bca3a2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.152899 May 27 15:22:14.428012 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 464/922] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:14 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:15.446321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:15.446964 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.453780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.454267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.455043 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.455488 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.588916 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.597981 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.599801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.601139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1f5088b8-d106-4bce-97ec-5f8a9d6901d3 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.158892 May 27 15:22:15.601774 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 459/923] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:15 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:16.621169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:16.621772 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:16.628650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:16.629108 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:16.629881 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:16.630324 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:16.757727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:16.766166 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:16.767675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:16.768859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d2ff714e-2565-4507-bcd8-4c598767d87d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.152279 May 27 15:22:16.769407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 465/924] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:16 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:17.786838 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:17.787452 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:17.795094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.795549 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.796315 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.796783 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.936669 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.945184 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.946734 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.948372 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-18661cfa-e3d7-42d5-90c2-a840b997630a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.165044 May 27 15:22:17.949023 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 460/925] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:17 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:18.967374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:18.967927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:18.974758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:18.975215 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:18.975983 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:18.976473 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.105915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.113735 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.115253 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.116407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2f2a9563-1b25-49ca-914f-76315b8c722d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.153564 May 27 15:22:19.116995 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 466/926] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:18 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:19.550985 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:19.551591 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:19.558039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.559291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.560069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.560585 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.585013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:19.665251 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-60b77e19-80f6-4130-b91c-3a3f34922eb3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 204 len: 0 microversion: 2.1 time: 0.117911 May 27 15:22:19.665863 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 461/927] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:22:19 2022] DELETE /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:22:19.674529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:19.675134 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:19.681093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.681538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.682287 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.682715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.819186 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.828348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0f9974b5-89ec-49ba-b48f-c5568b6ebe98 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1576 microversion: 2.1 time: 0.157613 May 27 15:22:19.828954 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 467/928] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:19 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:20.134987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:20.135719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:20.142360 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.142820 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.143587 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.144032 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.273560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:20.282804 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:20.284359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:20.285597 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b5bd20b7-f0f5-4fd5-a03a-323c15ba17b9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.154961 May 27 15:22:20.286159 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 462/929] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:20 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:20.846590 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:20.847590 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:20.854007 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.854468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.855847 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.856291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.985874 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:20.993358 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b53dab13-ad24-4d6f-824f-075264052379 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1576 microversion: 2.1 time: 0.150948 May 27 15:22:20.993914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 468/930] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:20 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:21.303178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:21.303793 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:21.311060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:21.311512 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:21.312284 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:21.312748 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:21.445262 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.453857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.455368 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.456620 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ae0a7e43-4809-4bdd-9338-a873003657dd tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.157386 May 27 15:22:21.457188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 463/931] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:21 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:22.010436 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:22.010967 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:22.017606 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.018066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.018834 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.019277 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.151348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.159830 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-65dc71d2-5978-4ef0-b455-de29286f801a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1576 microversion: 2.1 time: 0.153266 May 27 15:22:22.160458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 469/932] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:22 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:22.235775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-20b067e4-2006-455b-a375-54acb0a97714 req-dd77544f-29e4-482b-ba79-afe17ff357f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "name": "network-vif-plugged", "status": "completed", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:22.243742 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-20b067e4-2006-455b-a375-54acb0a97714 req-dd77544f-29e4-482b-ba79-afe17ff357f1 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.244184 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-20b067e4-2006-455b-a375-54acb0a97714 req-dd77544f-29e4-482b-ba79-afe17ff357f1 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.255758 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-20b067e4-2006-455b-a375-54acb0a97714 req-dd77544f-29e4-482b-ba79-afe17ff357f1 service nova] Creating event network-vif-plugged:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:22:22.260891 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-20b067e4-2006-455b-a375-54acb0a97714 req-dd77544f-29e4-482b-ba79-afe17ff357f1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028754 May 27 15:22:22.261436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 464/933] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:22.474750 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:22.475361 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:22.481478 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.481931 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.482727 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.483259 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.614200 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.622100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.623744 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.624930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9fe76a93-05f9-48ce-80e0-1fdb5bf56d04 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.154412 May 27 15:22:22.625483 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 470/934] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:22 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:23.179039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:23.179649 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:23.187037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.187482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.188247 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.188712 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.320390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.328008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1643c3d7-b98c-47dc-9756-ed40f1a7d8e8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1576 microversion: 2.1 time: 0.153802 May 27 15:22:23.328602 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 465/935] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:23 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:23.642453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:23.643101 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:23.649721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.650172 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.650962 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.651384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.780640 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.788527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.790072 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.791234 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c1e5e441-2604-4a98-880e-13fbd55beff2 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1742 microversion: 2.20 time: 0.152853 May 27 15:22:23.791783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 471/936] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:23 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:24.345979 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:24.346681 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:24.353224 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.353689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.354470 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.355128 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.628336 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:24.638899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ac78a30b-2ff7-4720-92bb-3d2eec7c3f46 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1576 microversion: 2.1 time: 0.296990 May 27 15:22:24.642321 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 466/937] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:24 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1576 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:24.810326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:24.811598 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:24.819829 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.820328 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.821193 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.821642 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.045045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-bbbf2166-426f-451e-bb04-aab8d334866b req-e834bfb3-0a4e-4b4e-bc83-2790bccb8871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd6a168-957b-4d55-ab12-8663ff7d32db", "name": "network-vif-deleted", "tag": "8c356400-bf9a-47c2-a37f-8842fb2fb68f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:25.075525 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:25.088206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:25.088589 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bbbf2166-426f-451e-bb04-aab8d334866b req-e834bfb3-0a4e-4b4e-bc83-2790bccb8871 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.089069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bbbf2166-426f-451e-bb04-aab8d334866b req-e834bfb3-0a4e-4b4e-bc83-2790bccb8871 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.095777 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:25.101810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a447bdaf-ab81-4790-b74f-4e9bad304a8b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.294826 May 27 15:22:25.102390 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 472/938] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:24 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:25.127457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-bbbf2166-426f-451e-bb04-aab8d334866b req-e834bfb3-0a4e-4b4e-bc83-2790bccb8871 service nova] Creating event network-vif-deleted:8c356400-bf9a-47c2-a37f-8842fb2fb68f for instance cbd6a168-957b-4d55-ab12-8663ff7d32db on hv-cinder-84254 May 27 15:22:25.132777 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-bbbf2166-426f-451e-bb04-aab8d334866b req-e834bfb3-0a4e-4b4e-bc83-2790bccb8871 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097823 May 27 15:22:25.133902 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 467/939] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:25.657602 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:25.658583 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:25.665302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.666030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.667044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.668308 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.701792 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.702506 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.703371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lazy-loading 'fault' on Instance uuid cbd6a168-957b-4d55-ab12-8663ff7d32db {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:25.747589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:25.757805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f58da045-0eeb-4bf9-8aab-9a9d2713fc71 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 200 len: 1230 microversion: 2.1 time: 0.103992 May 27 15:22:25.767679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 473/940] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:25 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:26.127240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:26.128524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:26.137278 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.138429 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.139332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.139952 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.174670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:26.175919 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:26.183438 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.184138 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.185422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.186204 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.321099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.332619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.334636 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.336042 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c31e52e7-bdb4-445e-8e98-04ce4f9d653e tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.218787 May 27 15:22:26.337150 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 468/941] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:26 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:26.351863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:26.358263 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lazy-loading 'services' on Instance uuid 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:26.443789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-f4650c0f-d57b-44c3-a0cc-12a26356c3bb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "DELETE /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6/os-volume_attachments/ec7b7112-013b-4fe2-bfc3-158cecfd778a" status: 202 len: 0 microversion: 2.1 time: 0.272696 May 27 15:22:26.445015 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 474/942] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 15:22:26 2022] DELETE /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6/os-volume_attachments/ec7b7112-013b-4fe2-bfc3-158cecfd778a => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:22:26.775300 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:26.775945 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:26.782857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.783629 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.784513 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.785080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.800208 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] HTTP exception thrown: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Request method failure captured: May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db HTTP/1.1 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOv3eVYBlvuLpZq-c_JsEqC4Ji7DSMQkXRwD5YPAe9YRkaAzQoH5vahjKXnxGugJWVJeifE8bEl2URHmb2f-wyVgz4-R8auOh2IRDz1ik0CoFb8LFf7OtGYmabU2QMm1bSjEJiLqFWYdBERqtzuliZp2MUFo8aZ97AsuzM_bbTBNauc May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:22:26.801983 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67116cdacaa846138f7835ac5f53b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestVolumeBootPattern-1427295069 May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestVolumeBootPattern-1427295069-project May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 60ff7c679e9747898bbc44da1d885b36 May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestVolumeBootPattern-1427295069-project May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:22:26.803588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'cbd6a168-957b-4d55-ab12-8663ff7d32db'} May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:26.804463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:22:26.806052 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:22:26.808482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Returning 404 to user: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:26.809476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-feb3e0e5-78d1-4077-88a0-8387a2f57af3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 404 len: 111 microversion: 2.1 time: 0.038279 May 27 15:22:26.818181 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 469/943] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:26 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:26.915926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1997077478", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-938155760", "security_groups": [{"name": "tempest-secgroup-smoke-1722843886"}], "block_device_mapping_v2": [{"uuid": "65f66cbb-8d67-4d9a-9c7c-55783659791a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45fa6392-40e0-4a3e-b175-df35de1eff7e"}]}} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:27.046983 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.network.neutron [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] validate_networks() for [('45fa6392-40e0-4a3e-b175-df35de1eff7e', None, None, None, None, None)] {{(pid=117642) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:22:27.354844 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.358907 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.366688 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.367305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.368541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.369126 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.602910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:27.603409 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image limits 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:27.603781 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:27.604354 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image pref 0:0:0 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:27.604821 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.virt.hardware [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:27.616087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.616972 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.618008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.619090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.661868 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:27.670104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.671687 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.quota [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for user 60ff7c679e9747898bbc44da1d885b36 and project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117642) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:27.682632 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.685604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.688239 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ce827ff7-4f12-458e-b9e3-776a7d0a7bed tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.337198 May 27 15:22:27.692496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 470/944] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:27.695790 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.696496 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.709621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.710077 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.710913 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.711530 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.750519 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:27.794444 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Going to run 1 instances... {{(pid=117642) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:22:27.796926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65f66cbb-8d67-4d9a-9c7c-55783659791a',volume_size=None,volume_type=None)] {{(pid=117642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:22:27.872501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e73c5a2b-ea5d-4c61-9934-88b424fd1b8a tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "DELETE /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 204 len: 0 microversion: 2.1 time: 0.181097 May 27 15:22:27.873497 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 471/945] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:22:27 2022] DELETE /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:27.883443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.884356 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.892029 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.892520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.893703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.894364 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.008189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e59850b8-cc25-4c9d-96cb-c710777ae3ce tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096623 May 27 15:22:28.015669 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 475/946] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:22:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:22:28.022281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-734f05c2-ebda-4e1a-93ca-c52c943d6616 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:28.023207 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-734f05c2-ebda-4e1a-93ca-c52c943d6616 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:28.178484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-734f05c2-ebda-4e1a-93ca-c52c943d6616 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.189732 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-734f05c2-ebda-4e1a-93ca-c52c943d6616 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1094 microversion: 2.1 time: 0.172184 May 27 15:22:28.196006 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.203329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 476/947] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:28 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1094 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:28.204988 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:28.215099 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9598216c-fb22-44ed-b2a6-ef6eb61376e7 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1514 microversion: 2.1 time: 0.336268 May 27 15:22:28.215987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 472/948] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:28.706265 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:28.707586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:28.715061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:28.716169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.716984 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:28.717584 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.897535 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.906868 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.908719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.910082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4ca9c3ec-f2bf-4643-bc4d-2d0a555be9d8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.207730 May 27 15:22:28.911244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 477/949] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:28 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:29.210526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.211757 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.223258 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.223716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.224531 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.224997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.239462 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.246928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.264373 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.264857 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.265634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.266076 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.307155 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.316264 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-16c9e086-c203-42e8-816f-d8d3f621e6ea tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1144 microversion: 2.1 time: 0.109761 May 27 15:22:29.326660 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 473/950] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:29.426445 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.435110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ae221f6f-9a44-4e7b-a103-e435d5a2d66d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1514 microversion: 2.1 time: 0.206071 May 27 15:22:29.436810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 478/951] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:29.929421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.930041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.936467 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.936942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.937731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.938178 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.137053 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:30.145561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:30.151242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:30.153560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b6a4d14a-6806-4c25-80cd-56450e4dabbc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.227862 May 27 15:22:30.164567 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 474/952] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:30.333964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:30.335286 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:30.343380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.343841 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.344670 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.345120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.455548 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:30.456440 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:30.462288 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:30.466520 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.476516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.476516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.476516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.487134 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-70b762c6-5a6c-4498-bdc8-4226da498ef1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1192 microversion: 2.1 time: 0.157079 May 27 15:22:30.488117 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 479/953] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:30 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1192 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:31.137359 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.150457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7ada0432-120f-4d0c-88ee-670d7c5f8feb tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1514 microversion: 2.1 time: 0.702993 May 27 15:22:31.163167 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 475/954] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:30 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1514 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:31.172158 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:31.172904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:31.185311 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.185870 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.187615 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.189081 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.507650 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.510134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:31.510758 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:31.529902 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.531528 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.532765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7259bc68-0e7d-41dd-ace7-86475940d8a1 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.365579 May 27 15:22:31.533330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.533851 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.535064 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.535254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.550236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 480/955] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:31 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:31.714543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-fe2a33ca-0407-4629-8a8d-f81f8243236c req-87334985-f169-4679-a08e-7d674f8195a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ced399-f5f9-4d5b-800d-6f6dfc86fdd6", "name": "network-vif-deleted", "tag": "eec3b38f-cd0e-4e34-97d0-1afc972d7b2b"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:31.736278 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-fe2a33ca-0407-4629-8a8d-f81f8243236c req-87334985-f169-4679-a08e-7d674f8195a6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.737037 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-fe2a33ca-0407-4629-8a8d-f81f8243236c req-87334985-f169-4679-a08e-7d674f8195a6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.764648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-fe2a33ca-0407-4629-8a8d-f81f8243236c req-87334985-f169-4679-a08e-7d674f8195a6 service nova] Creating event network-vif-deleted:eec3b38f-cd0e-4e34-97d0-1afc972d7b2b for instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 on hv-cinder-84254 May 27 15:22:31.780369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-fe2a33ca-0407-4629-8a8d-f81f8243236c req-87334985-f169-4679-a08e-7d674f8195a6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071238 May 27 15:22:31.783232 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 481/956] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:31.823082 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.832263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e79cc2d4-8d2b-4840-9b49-77b5264cf6cf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.328679 May 27 15:22:31.843002 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 476/957] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:31 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:32.173577 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:32.174286 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:32.199412 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.200224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.203465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.208582 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.276010 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.276669 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.277385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lazy-loading 'fault' on Instance uuid 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:32.352084 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c0fe34091fa457ba6a20f6d0b9fb016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be77db463e844d0a8078b9fd07b7a968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.364865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a78e1b39-467b-4654-8969-4303e8066064 tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 200 len: 1309 microversion: 2.1 time: 0.198135 May 27 15:22:32.381063 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 482/958] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:32 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:32.564407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:32.565323 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:32.592909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.596679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.603251 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.606552 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.662666 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-c2ad3e02-fd74-487d-b4a5-756b35fe15db req-63b364af-e957-4309-89e3-efc2612f0c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f73f360-1774-417e-8c7e-f389b8ad5891", "tag": "d75474e9-e17b-408a-97d0-f07e572297fa"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:32.697710 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-c2ad3e02-fd74-487d-b4a5-756b35fe15db req-63b364af-e957-4309-89e3-efc2612f0c01 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.702524 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-c2ad3e02-fd74-487d-b4a5-756b35fe15db req-63b364af-e957-4309-89e3-efc2612f0c01 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.737616 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-c2ad3e02-fd74-487d-b4a5-756b35fe15db req-63b364af-e957-4309-89e3-efc2612f0c01 service nova] Creating event network-changed:d75474e9-e17b-408a-97d0-f07e572297fa for instance 9f73f360-1774-417e-8c7e-f389b8ad5891 on hv-cinder-84254 May 27 15:22:32.754951 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-c2ad3e02-fd74-487d-b4a5-756b35fe15db req-63b364af-e957-4309-89e3-efc2612f0c01 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207593 May 27 15:22:32.762231 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 477/959] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:32.853060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:32.855847 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:32.864205 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.864570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.865134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.866139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.866801 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.877753 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.879503 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.881118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0c087bd7-78c3-46a5-ba59-62c2f40f0f72 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.327372 May 27 15:22:32.895159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 483/960] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:32 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:33.054511 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:33.064186 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-81596937-caff-4371-9a44-db32f9738a35 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.217070 May 27 15:22:33.074393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 478/961] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:32 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:33.389414 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:33.390301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] [instance: 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:33.406914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.406914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.406914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.406914 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] HTTP exception thrown: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Request method failure captured: May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 HTTP/1.1 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOxRVzCE6hdfWnSQsIH45rtKk6rHRzTkBQH6WiBAmuUt07IhiGVbNc105XukGEDIA_BYHkTpr2vsQQjGKqkZXScrY9ducwD3ZbQQo_rv8cFDy9TCkDPGMwrp8_k6AXaS7rPNwq_t54T9BgSFT0eOzqh2198rsSK_k2MSgsXzHK31_ZI May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: be77db463e844d0a8078b9fd07b7a968 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:22:33.424853 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/be77db463e844d0a8078b9fd07b7a968"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: be77db463e844d0a8078b9fd07b7a968 May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1240087653 May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-VolumesSnapshotTestJSON-1240087653-project May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 2c0fe34091fa457ba6a20f6d0b9fb016 May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-VolumesSnapshotTestJSON-1240087653-project May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. May 27 15:22:33.426437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '71ced399-f5f9-4d5b-800d-6f6dfc86fdd6'} May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:33.427246 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. May 27 15:22:33.430447 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:22:33.433715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] Returning 404 to user: Instance 71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:33.433715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ef9a8783-37be-489e-aa95-bb33af5c5a7d tempest-VolumesSnapshotTestJSON-1240087653 tempest-VolumesSnapshotTestJSON-1240087653-project] 10.222.0.41 "GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6" status: 404 len: 111 microversion: 2.1 time: 0.042843 May 27 15:22:33.433715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 484/962] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:33 2022] GET /compute/v2.1/servers/71ced399-f5f9-4d5b-800d-6f6dfc86fdd6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:33.903499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:33.904748 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:33.916197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.916684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.918555 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.919241 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:34.081676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:34.085104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.091254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:34.099870 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.102016 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.103296 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-45ef1fe7-0660-498b-a955-351005505532 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.205061 May 27 15:22:34.104240 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 479/963] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:33 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:34.114958 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:34.115756 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:34.116826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:34.117555 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:34.308565 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.317132 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0e1f5ee4-3b31-40ae-985d-434e2daf7003 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.239481 May 27 15:22:34.317692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 485/964] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:34 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:35.123869 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:35.124501 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:35.131041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.131491 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.132250 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.132722 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.262569 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:35.270553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:35.272152 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:35.273402 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ad298e54-2739-4ed5-8114-0c528eee1c54 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.154526 May 27 15:22:35.273955 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 480/965] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:35 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:35.334865 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:35.335477 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:35.342730 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.343189 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.343955 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.344400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.491482 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:35.500879 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e53b5fa0-6cce-4353-ac11-d3cf1e88ebc5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.169795 May 27 15:22:35.501731 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 486/966] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:35 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:36.291249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:36.291790 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:36.298411 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.298862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.299629 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.300069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.430044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.438839 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.440351 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.441551 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-aee8ec90-632a-4a4f-9a45-56c9e314499f tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.154401 May 27 15:22:36.442109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 481/967] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:36 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:36.517971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:36.518582 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:36.525229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.525680 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.526452 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.526948 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.658952 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.666468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8f0b3cc1-f471-40c2-8d95-ab05a8e5ad78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.152406 May 27 15:22:36.667031 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 487/968] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:36 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:37.459630 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.460275 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.467092 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.467553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.468327 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.468815 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.601664 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.610492 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.612011 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.613209 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7ec388d5-5fb7-49f3-8648-883652e201b6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1737 microversion: 2.20 time: 0.157551 May 27 15:22:37.613768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 482/969] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:37 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:37.684212 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.684922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.687326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.693018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.693471 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.694245 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.694689 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.823380 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.830748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6d44215d-2f25-4047-87a7-bc4e07353d40 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.151109 May 27 15:22:37.831309 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 488/970] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:37 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:38.631993 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.633354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.641131 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.641612 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.642392 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.642857 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.777619 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.785468 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.786963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.788106 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9fdc54cf-984c-4a20-9b2c-20cb8b139c13 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1719 microversion: 2.20 time: 0.160678 May 27 15:22:38.788691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 483/971] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:38 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:38.848676 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.849291 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.851118 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=8 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:38.857610 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.858001 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.858764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.859205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.992414 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.000713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2456af9b-9d32-4fb7-9cd8-a526ffea5fb5 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.156201 May 27 15:22:39.001270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 489/972] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:38 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:39.806222 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:39.806832 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:39.813768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:39.814214 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.814976 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:39.815414 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.946864 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.955473 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.957035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.958203 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-734daefb-fc1f-4635-b4cd-8d33b618afa9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1719 microversion: 2.20 time: 0.155905 May 27 15:22:39.958786 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 484/973] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:39 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:40.017880 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.018489 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.025008 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.025453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.026205 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.027206 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.159404 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.166884 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c3894f48-00f4-4cd5-9126-d3d8abc92bfa tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.152966 May 27 15:22:40.168079 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 490/974] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:40.292081 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-b0bc236f-6f8c-44ab-bf41-1071494c9cad req-677381bb-541f-45ff-89cb-5aa269533573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "name": "network-vif-unplugged", "status": "completed", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:40.301566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b0bc236f-6f8c-44ab-bf41-1071494c9cad req-677381bb-541f-45ff-89cb-5aa269533573 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.302013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b0bc236f-6f8c-44ab-bf41-1071494c9cad req-677381bb-541f-45ff-89cb-5aa269533573 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.314621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-b0bc236f-6f8c-44ab-bf41-1071494c9cad req-677381bb-541f-45ff-89cb-5aa269533573 service nova] Creating event network-vif-unplugged:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:22:40.319827 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-b0bc236f-6f8c-44ab-bf41-1071494c9cad req-677381bb-541f-45ff-89cb-5aa269533573 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031427 May 27 15:22:40.320353 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 485/975] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:40.977748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.978442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.985032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.985492 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.986275 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.986724 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.114990 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:41.123773 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:41.125321 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:41.126490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8b3986b7-4c03-4744-a768-b52032ef8bd9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1719 microversion: 2.20 time: 0.153162 May 27 15:22:41.127040 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 491/976] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:41.185761 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:41.186498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:41.193013 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.193463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.194231 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.194672 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.330502 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:41.338376 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fbdbe152-7e08-47c8-8a25-d327203541c4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.157789 May 27 15:22:41.338941 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 486/977] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:41 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:42.145044 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.145579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.147872 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:42.153742 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.154258 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.155030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.155469 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.290978 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.299221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.300758 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.301927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2ff3f28c-5ba8-4b19-b82a-e44fb18f2c26 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1662 microversion: 2.20 time: 0.160924 May 27 15:22:42.302488 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 492/978] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:42 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:42.320745 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1b1df51-e005-4019-9e54-978d7467e870"}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:42.321855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.329589 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.330031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.330811 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.331259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.357033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.358305 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.364666 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.365220 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.366124 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.366633 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.394442 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:42.527497 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.535244 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41a3640c-9ca3-4dc1-ab2f-65b57852a276 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.182798 May 27 15:22:42.535797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 493/979] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:42 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:42.632039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-60dd20c4-bbab-4387-b24d-d3472af86ca5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315715 May 27 15:22:42.632668 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 487/980] 10.222.0.41 () {62 vars in 1363 bytes} [Fri May 27 15:22:42 2022] POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:22:42.760561 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.761272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.767403 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.767928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.768810 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.769307 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.028363 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-398e8e46-6139-4204-a1cb-b00eda81765b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments/f1b1df51-e005-4019-9e54-978d7467e870" status: 202 len: 0 microversion: 2.20 time: 0.271804 May 27 15:22:43.029016 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 494/981] 10.222.0.41 () {60 vars in 1456 bytes} [Fri May 27 15:22:42 2022] DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments/f1b1df51-e005-4019-9e54-978d7467e870 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:43.099578 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:43.100161 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.107746 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.108225 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.109100 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.109568 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.113456 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:43.208984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:43.269261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f85d84b3-f75f-4df0-99ae-1d762cb8506a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/action" status: 202 len: 0 microversion: 2.20 time: 0.173856 May 27 15:22:43.269879 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 488/982] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 15:22:43 2022] POST /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:43.278701 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.279317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.286712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.287168 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.287951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.288402 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.426086 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.434272 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.435789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.437027 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a5b09076-9ecc-4231-b9a0-47049f8b5c3a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1670 microversion: 2.20 time: 0.163033 May 27 15:22:43.437625 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 495/983] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:43.552435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.553113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.559685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.560147 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.560984 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.561435 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.699432 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.707060 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0d276fa2-f5a3-464c-92ba-108b8161522a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.158494 May 27 15:22:43.707629 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 489/984] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:44.456066 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.457371 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.465789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.466243 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.467026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.467639 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.597245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-066c47f5-e9a4-401b-8bfd-8930f43a4683 req-6ccf6823-e6cf-4f5a-95dc-4906ea74819f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f73f360-1774-417e-8c7e-f389b8ad5891", "name": "network-vif-plugged", "status": "completed", "tag": "d75474e9-e17b-408a-97d0-f07e572297fa"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:44.607812 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-066c47f5-e9a4-401b-8bfd-8930f43a4683 req-6ccf6823-e6cf-4f5a-95dc-4906ea74819f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.608080 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.608264 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-066c47f5-e9a4-401b-8bfd-8930f43a4683 req-6ccf6823-e6cf-4f5a-95dc-4906ea74819f service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.617407 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.618915 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.620083 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2bbf3e01-e430-47b9-ac9d-c9a7880c6b73 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1670 microversion: 2.20 time: 0.168052 May 27 15:22:44.621616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 496/985] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:44 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:44.624928 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-066c47f5-e9a4-401b-8bfd-8930f43a4683 req-6ccf6823-e6cf-4f5a-95dc-4906ea74819f service nova] Creating event network-vif-plugged:d75474e9-e17b-408a-97d0-f07e572297fa for instance 9f73f360-1774-417e-8c7e-f389b8ad5891 on hv-cinder-84254 May 27 15:22:44.630553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-066c47f5-e9a4-401b-8bfd-8930f43a4683 req-6ccf6823-e6cf-4f5a-95dc-4906ea74819f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037768 May 27 15:22:44.631449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 490/986] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:44.725726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.726345 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.732825 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.733270 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.734032 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.734467 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.878957 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.886579 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d44f15a2-37f2-4e23-a51b-7c9acd1882a7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.165087 May 27 15:22:44.887141 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 497/987] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:44 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:45.640271 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:45.640922 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:45.647592 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.648047 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.648850 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.649291 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.782610 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.790575 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.792104 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.793299 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3c951e6b-1e34-45f4-afa5-9e6166532f6d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1672 microversion: 2.20 time: 0.158167 May 27 15:22:45.793853 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 491/988] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:45 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:45.903281 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:45.903910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:45.910465 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.910918 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.911714 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.912157 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.045589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.053110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-58de409a-d93c-4827-b578-9f0854aeb188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.153957 May 27 15:22:46.053666 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 498/989] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:45 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:46.812076 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:46.812780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:46.819370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.819830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.820650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.821101 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.985305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.993069 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.994586 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.996715 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-1486b9be-ec19-4c6a-96db-a74323c833e7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.188858 May 27 15:22:46.997279 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 492/990] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:46 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:47.070095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:47.070704 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:47.077889 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.078334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.079092 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.079524 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.269029 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.277998 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf6472fc-22c3-4741-aead-e16b3d28aaba tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.211489 May 27 15:22:47.279090 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 499/991] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:47 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:48.017348 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:48.018008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:48.024482 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.024940 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.025768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.026208 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.163044 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.172421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.174242 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.175421 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-fbc7d2d4-f440-4557-804a-86519f2ae7aa tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.164652 May 27 15:22:48.175987 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 493/992] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:48 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:48.295033 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:48.295644 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:48.302306 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.302784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.303544 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.304018 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.437859 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.445783 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2639db71-d724-49ad-9b8f-01347fac9537 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1266 microversion: 2.1 time: 0.154674 May 27 15:22:48.446348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 500/993] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:48 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:49.195894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.197427 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.205862 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.206690 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.207649 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.208365 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.352302 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.361963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.363466 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.365008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-64dac5d2-8eda-43be-9f74-0dd2c02caf74 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.174604 May 27 15:22:49.365561 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 494/994] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:49.463273 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.463966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.471661 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.472120 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.472929 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.473372 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.613847 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.622603 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-78429041-1002-45a1-9855-72fc7c21b26a tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1452 microversion: 2.1 time: 0.163066 May 27 15:22:49.623456 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 501/995] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:49.639604 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.640221 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.646612 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.647061 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.647860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.648309 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.789539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.797731 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0482254d-6afc-4613-8bc4-06dd6b31a188 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1452 microversion: 2.1 time: 0.162481 May 27 15:22:49.798305 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 495/996] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:50.383604 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:50.384904 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:50.398000 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.398780 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.399590 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.400034 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.633370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.643916 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.645790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.647194 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-a8662e55-c865-433b-8233-ac20afe55e30 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.268111 May 27 15:22:50.658369 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 502/997] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:50 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:51.669789 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:51.676322 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:51.691185 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.693463 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.694363 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.696846 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.866961 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [req-04a1959d-6c48-4be2-bc38-77d82f1e3ea0 req-b20e1189-f069-4687-9f99-9945894d1fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f73f360-1774-417e-8c7e-f389b8ad5891", "tag": "d75474e9-e17b-408a-97d0-f07e572297fa"}]} {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:51.876490 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-04a1959d-6c48-4be2-bc38-77d82f1e3ea0 req-b20e1189-f069-4687-9f99-9945894d1fae service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.877315 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [req-04a1959d-6c48-4be2-bc38-77d82f1e3ea0 req-b20e1189-f069-4687-9f99-9945894d1fae service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.891748 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.compute.server_external_events [req-04a1959d-6c48-4be2-bc38-77d82f1e3ea0 req-b20e1189-f069-4687-9f99-9945894d1fae service nova] Creating event network-changed:d75474e9-e17b-408a-97d0-f07e572297fa for instance 9f73f360-1774-417e-8c7e-f389b8ad5891 on hv-cinder-84254 May 27 15:22:51.903565 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [req-04a1959d-6c48-4be2-bc38-77d82f1e3ea0 req-b20e1189-f069-4687-9f99-9945894d1fae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161831 May 27 15:22:51.904824 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 503/998] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:51.957406 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.969172 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.971295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.972717 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-09af23f7-82c4-4bfb-a77a-e6a5d14057f5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.311021 May 27 15:22:51.973799 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 496/999] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:51 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:52.992910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:52.994493 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.001476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.002314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.003164 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.003679 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.146648 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.155787 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.157437 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.158601 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-68867d8c-abc5-4ac9-90ad-cad48c9feff5 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.170810 May 27 15:22:53.159159 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 504/1000] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:52 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:54.288200 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:54.288896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:54.297025 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.297813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.298600 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.299045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.447885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:54.456802 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:54.458370 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:54.459687 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-23e01787-7752-4b77-a45f-66d8cea1e3c8 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.285666 May 27 15:22:54.460248 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 497/1001] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:54 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:55.478826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:55.480061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:55.486249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.486706 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.487487 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.487926 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.634618 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.643999 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.646121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.647709 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0a8b98c5-272a-4cb2-a83c-7ae1bf04e2eb tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.173023 May 27 15:22:55.648331 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 505/1002] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:55 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:56.666707 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.668180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.675074 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.675528 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.676297 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.676943 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.813695 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.826886 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.828887 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.830334 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ac9bf9f0-ebc1-413b-a9db-b04d35406b6b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.167537 May 27 15:22:56.831026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 498/1003] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:57.849230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:57.849855 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:57.864125 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.865188 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.866195 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.866817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.034751 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.043699 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.045286 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.046522 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-52669bb2-2ad6-4a28-92bd-5a59ccc6823d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.201432 May 27 15:22:58.047455 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 506/1004] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:57 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:59.064872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:59.065474 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:59.072037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.072526 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.074008 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.074459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.205333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.213324 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.215514 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.216711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-850d96d2-8dca-4393-8d30-95eb8359bbfe tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.155829 May 27 15:22:59.217267 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 499/1005] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:22:59 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:00.235385 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:00.236002 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:00.242643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.243100 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.243930 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.244395 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.380849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:00.389137 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:00.390655 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:00.391817 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a7b3b35-7bc5-48c8-a460-f08582d7d7b0 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.160391 May 27 15:23:00.392366 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 507/1006] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:00 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:01.410730 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:01.411444 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:01.418641 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:01.419139 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:01.419935 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:01.420382 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:01.548493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:01.556702 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:01.558871 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:01.560037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-c222a2c9-b2a0-488f-bca8-4db50d5ad097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.153533 May 27 15:23:01.560634 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 500/1007] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:01 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:02.578877 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:02.579631 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:02.586208 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.586664 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.587651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.588099 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.603428 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:02.656072 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-1403a6bc-6b7b-452f-9d1c-f4be35054dfd req-3d3c3b49-2396-453c-9593-5a277917fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "name": "network-vif-plugged", "status": "completed", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:02.665280 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-1403a6bc-6b7b-452f-9d1c-f4be35054dfd req-3d3c3b49-2396-453c-9593-5a277917fc4b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.665780 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-1403a6bc-6b7b-452f-9d1c-f4be35054dfd req-3d3c3b49-2396-453c-9593-5a277917fc4b service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.685706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-1403a6bc-6b7b-452f-9d1c-f4be35054dfd req-3d3c3b49-2396-453c-9593-5a277917fc4b service nova] Creating event network-vif-plugged:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:23:02.691405 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-1403a6bc-6b7b-452f-9d1c-f4be35054dfd req-3d3c3b49-2396-453c-9593-5a277917fc4b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 May 27 15:23:02.692254 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 501/1008] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:23:02.731911 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:02.740283 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:02.741816 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:02.742971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-562a0fd0-0e58-4608-9af5-7fb5cfdd473b tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.168166 May 27 15:23:02.743527 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 508/1009] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:02 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:23:03.764055 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:03.764701 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:03.770950 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:03.771409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:03.772180 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:03.772653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:03.960713 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:03.972942 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:03.974476 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:03.975703 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-74d32b5e-dc0a-4779-9b89-14aacbb4c79a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.217474 May 27 15:23:03.976269 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 502/1010] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:03 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:04.994519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:04.995173 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:05.002419 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.002876 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.003652 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.004095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.214805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:05.223464 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:05.225143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:05.226396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c061213a-a5a2-43ec-9e5e-6c37868d7e78 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1728 microversion: 2.20 time: 0.235788 May 27 15:23:05.227107 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 509/1011] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:04 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:06.244813 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:06.245894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:06.252656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.253113 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.253885 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.254330 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.383090 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:06.391560 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:06.393131 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:06.394337 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-065676a9-832d-4d42-9114-96a82039c632 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1715 microversion: 2.20 time: 0.153610 May 27 15:23:06.394898 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 503/1012] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:06 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:48.285317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:48.286252 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:48.288249 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=35 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:48.288937 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=9 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:48.295654 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.296106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.296913 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.297353 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.326096 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e0916319-37d9-445f-af84-3cdc1d70b0cc tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044881 May 27 15:23:48.326643 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 510/1013] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 15:23:48 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:48.385295 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:48.385894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:48.388323 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=31 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:48.389039 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:48.394972 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.395433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.396215 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.396691 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.422559 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Going to try to terminate instance {{(pid=117641) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:23:48.497754 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0c330b17-e1ff-4c17-b4c0-fe20d11d785a tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 204 len: 0 microversion: 2.20 time: 0.116116 May 27 15:23:48.498770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 504/1014] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 15:23:48 2022] DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:23:48.507928 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:48.508578 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:48.516400 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.517149 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.517927 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.518368 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.653352 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:48.661634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:48.663152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:48.664312 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-8d2635c7-a7dd-47df-8430-0b3d32d43af7 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.161286 May 27 15:23:48.664909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 511/1015] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:48 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:49.683141 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:49.683860 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:49.690443 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:49.690901 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:49.691674 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:49.692117 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:49.822420 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:49.831705 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:49.833573 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:49.834903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-75f35ca0-eb4e-48a1-89af-5a16cd326097 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1721 microversion: 2.20 time: 0.156077 May 27 15:23:49.835785 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 505/1016] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:49 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:50.854074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:50.855398 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:50.862233 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:50.862707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:50.863476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:50.863910 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:50.946234 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:50.955343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:50.957030 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '973c068eff44436785ddf19a6465da8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d48e2adc1e4c6ebfdd43e84f8e3106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:50.958297 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b199786f-0994-4de4-9121-5836df8a1dc9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 200 len: 1653 microversion: 2.20 time: 0.108263 May 27 15:23:50.958882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 512/1017] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:50 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 1653 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:23:51.060028 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-941bdcf0-de1d-4d88-aa0a-9c95f7b1e3d0 req-811ac3e1-b3c4-427f-886e-3b6e2f5baedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8632102f-28fe-4b73-bd34-b51fc1c3179c", "name": "network-vif-deleted", "tag": "5957996d-9971-4147-ab43-4d9b1a9273d5"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:51.071977 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-941bdcf0-de1d-4d88-aa0a-9c95f7b1e3d0 req-811ac3e1-b3c4-427f-886e-3b6e2f5baedc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:51.072433 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-941bdcf0-de1d-4d88-aa0a-9c95f7b1e3d0 req-811ac3e1-b3c4-427f-886e-3b6e2f5baedc service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:51.084894 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-941bdcf0-de1d-4d88-aa0a-9c95f7b1e3d0 req-811ac3e1-b3c4-427f-886e-3b6e2f5baedc service nova] Creating event network-vif-deleted:5957996d-9971-4147-ab43-4d9b1a9273d5 for instance 8632102f-28fe-4b73-bd34-b51fc1c3179c on hv-cinder-84254 May 27 15:23:51.091004 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-941bdcf0-de1d-4d88-aa0a-9c95f7b1e3d0 req-811ac3e1-b3c4-427f-886e-3b6e2f5baedc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 May 27 15:23:51.092158 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 506/1018] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:51.979053 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:51.980240 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:51.986974 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:51.987421 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:51.989526 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:51.989919 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:52.004289 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c HTTP/1.1 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:23:52.006405 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:52.008190 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '8632102f-28fe-4b73-bd34-b51fc1c3179c'} May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:52.009087 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:52.010458 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:52.012262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:52.012262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-618881e0-692f-4ca4-9bba-b5df543ff0a9 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 404 len: 111 microversion: 2.20 time: 0.033055 May 27 15:23:52.012262 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 513/1019] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:51 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:52.017611 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-0687876a-097c-4e3d-85a8-449a889c0c68 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '.version_select at 0x7fa372793ee0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:52.020870 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0687876a-097c-4e3d-85a8-449a889c0c68 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [6f86dd18-8521-4890-85ff-408e42df034b] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:23:53.029412 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [None req-0687876a-097c-4e3d-85a8-449a889c0c68 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [6f86dd18-8521-4890-85ff-408e42df034b] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40338. May 27 15:23:53.047535 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-0687876a-097c-4e3d-85a8-449a889c0c68 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889393898" status: 204 len: 0 microversion: 2.20 time: 1.034142 May 27 15:23:53.048157 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 507/1020] 10.222.0.41 () {60 vars in 1258 bytes} [Fri May 27 15:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889393898 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:23:53.699074 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:23:53.699668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:23:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:23:54.795370 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:54.795934 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:54.803113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.803568 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.804334 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.804814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.819123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c HTTP/1.1 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:23:54.820925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.822422 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '8632102f-28fe-4b73-bd34-b51fc1c3179c'} May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:54.823519 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.825097 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:54.826634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:54.826634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ea4bb3b4-c1d3-4a14-9dd5-fbd8e15a0e0d tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 404 len: 111 microversion: 2.20 time: 0.031776 May 27 15:23:54.826634 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 514/1021] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 15:23:54 2022] DELETE /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:54.832327 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:54.833191 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 8632102f-28fe-4b73-bd34-b51fc1c3179c] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:54.841720 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.842197 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.843131 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.843582 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.857765 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c HTTP/1.1 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:23:54.859409 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.861166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '8632102f-28fe-4b73-bd34-b51fc1c3179c'} May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:54.861995 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. May 27 15:23:54.863272 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:54.864416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 8632102f-28fe-4b73-bd34-b51fc1c3179c could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:54.864416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3dbeb812-0eef-43cf-b5ff-66c18afb9b62 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c" status: 404 len: 111 microversion: 2.20 time: 0.033170 May 27 15:23:54.864416 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 508/1022] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:54 2022] GET /compute/v2.1/servers/8632102f-28fe-4b73-bd34-b51fc1c3179c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:55.993290 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:55.993819 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:55.999784 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.000236 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.001042 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.001483 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.015326 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 HTTP/1.1 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:23:56.016895 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.018628 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': '734d5d69-34eb-44a2-a662-0399f6fb4932'} May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:56.019476 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.020782 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:23:56.022113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:56.022113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-2320cd11-93bd-47fe-8d35-491c8c4397e6 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 404 len: 111 microversion: 2.20 time: 0.029350 May 27 15:23:56.022113 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 515/1023] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 15:23:55 2022] DELETE /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:56.027494 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:56.028105 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] [instance: 734d5d69-34eb-44a2-a662-0399f6fb4932] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:56.034550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.034997 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.035754 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.036188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.049684 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] HTTP exception thrown: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Request method failure captured: May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 HTTP/1.1 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOuh7vkUqxN0SLb-tnxzc03nB5Jg8IBZ5znLZLw74hn9Ng6IJhWQbqLoj2lSCtlxaAWH6phkbvucXk8kw7VTPNEi5KKdHQiY4xvvQ9tGSnqnpe5Z9_bRhTF8lRwijmbUQrpqXzg8NOfCQMSmZTC_1tBO7rlFXdxa51Vq3net47hKjp4 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:23:56.051194 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/80d48e2adc1e4c6ebfdd43e84f8e3106"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 80d48e2adc1e4c6ebfdd43e84f8e3106 May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1279106739 May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 973c068eff44436785ddf19a6465da8f May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1279106739-project May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.052992 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '734d5d69-34eb-44a2-a662-0399f6fb4932'} May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:56.053954 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. May 27 15:23:56.055500 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:23:56.056934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] Returning 404 to user: Instance 734d5d69-34eb-44a2-a662-0399f6fb4932 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:56.056934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-4f993247-3c67-4c8c-8bee-6810c6443838 tempest-AttachVolumeShelveTestJSON-1279106739 tempest-AttachVolumeShelveTestJSON-1279106739-project] 10.222.0.41 "GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932" status: 404 len: 111 microversion: 2.20 time: 0.029801 May 27 15:23:56.056934 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 509/1024] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 15:23:56 2022] GET /compute/v2.1/servers/734d5d69-34eb-44a2-a662-0399f6fb4932 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:01.889226 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-ff635390-5788-4b08-9cbd-9e154adae29f tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa371f47b80>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:01.936850 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-ff635390-5788-4b08-9cbd-9e154adae29f tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0535e37c-d3d5-4882-bfd5-65e8ef838912" status: 200 len: 351 microversion: 2.1 time: 0.051376 May 27 15:24:01.937409 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 516/1025] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:24:01 2022] GET /compute/v2.1/os-volumes/0535e37c-d3d5-4882-bfd5-65e8ef838912 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:03.247354 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-3e0aeef9-a243-41c3-a423-ece26403f10b tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3728f8940>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.295422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-3e0aeef9-a243-41c3-a423-ece26403f10b tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ed8a8b0-fbf9-4870-a5fb-ac938df903d4" status: 200 len: 351 microversion: 2.1 time: 0.052461 May 27 15:24:03.296088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 510/1026] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/os-volumes/0ed8a8b0-fbf9-4870-a5fb-ac938df903d4 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:04.609932 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-4a326392-f263-4baa-9a5f-3d04bf8ffdee tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3720b0dc0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.658747 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-4a326392-f263-4baa-9a5f-3d04bf8ffdee tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/24f62f8e-6131-436f-b4bc-2d300801e7bb" status: 200 len: 350 microversion: 2.1 time: 0.053111 May 27 15:24:04.659317 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 517/1027] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes/24f62f8e-6131-436f-b4bc-2d300801e7bb => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:04.671498 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-563b5e6c-7808-47f3-bb18-c64c77376400 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3728c6ca0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.752868 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-563b5e6c-7808-47f3-bb18-c64c77376400 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086201 May 27 15:24:04.753457 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 511/1028] 10.222.0.41 () {58 vars in 1133 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:04.766218 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-3afe7f84-be3b-4f5f-9bcc-218b7e1747ea tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3720a5e50>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.845347 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-3afe7f84-be3b-4f5f-9bcc-218b7e1747ea tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082896 May 27 15:24:04.845947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 518/1029] 10.222.0.41 () {58 vars in 1148 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:04.857774 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9004166d-4f5c-4291-89a2-11c10ee1378b tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3728f8040>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.940626 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9004166d-4f5c-4291-89a2-11c10ee1378b tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086652 May 27 15:24:04.941196 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 512/1030] 10.222.0.41 () {58 vars in 1133 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:04.952925 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fd53eb21-76cb-47b4-8428-83833ee430f2 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa371f34940>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.035707 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fd53eb21-76cb-47b4-8428-83833ee430f2 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087307 May 27 15:24:05.036301 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 519/1031] 10.222.0.41 () {58 vars in 1166 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:05.047962 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-ca91fd37-3cc5-4a07-ab8b-fbed3b677916 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa372868ca0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.127911 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-ca91fd37-3cc5-4a07-ab8b-fbed3b677916 tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083678 May 27 15:24:05.128509 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 513/1032] 10.222.0.41 () {58 vars in 1169 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:05.140820 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-9c6154aa-04df-4b81-bdad-ea2205f724fe tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa37201adc0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.222683 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-9c6154aa-04df-4b81-bdad-ea2205f724fe tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085526 May 27 15:24:05.223257 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 520/1033] 10.222.0.41 () {58 vars in 1154 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:05.234404 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-60335e3e-80f7-4121-8a8b-b351ca4ca34a tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa3728cdca0>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.316283 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-60335e3e-80f7-4121-8a8b-b351ca4ca34a tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085603 May 27 15:24:05.316903 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 514/1034] 10.222.0.41 () {58 vars in 1187 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:05.329121 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-c20e3a7c-7bb9-438e-9d0b-efe5afe86a1c tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] Calling method '.version_select at 0x7fa371db4ee0>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.411110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-c20e3a7c-7bb9-438e-9d0b-efe5afe86a1c tempest-VolumesTestJSON-1833510858 tempest-VolumesTestJSON-1833510858-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085817 May 27 15:24:05.411693 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 521/1035] 10.222.0.41 () {58 vars in 1154 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:50.674791 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:50.675541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:50.680100 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2064871823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-938155760", "security_groups": [{"name": "tempest-secgroup-smoke-1722843886"}], "block_device_mapping_v2": [{"uuid": "f04bb234-651d-4475-b7be-d16fa4b7b2fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "45fa6392-40e0-4a3e-b175-df35de1eff7e"}]}} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:50.797153 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.network.neutron [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] validate_networks() for [('45fa6392-40e0-4a3e-b175-df35de1eff7e', None, None, None, None, None)] {{(pid=117641) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:24:51.173422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:24:51.173851 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image limits 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:24:51.174332 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Flavor pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:24:51.174750 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Image pref 0:0:0 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:24:51.175165 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.virt.hardware [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:24:51.184625 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.185083 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.185896 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.186340 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.203212 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:24:51.207188 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.quota [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Getting quotas for user 60ff7c679e9747898bbc44da1d885b36 and project 67116cdacaa846138f7835ac5f53b863. Resources: {'instances', 'cores', 'ram'} {{(pid=117641) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:24:51.264263 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Going to run 1 instances... {{(pid=117641) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:24:51.266461 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f04bb234-651d-4475-b7be-d16fa4b7b2fd',volume_size=None,volume_type=None)] {{(pid=117641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:24:51.395530 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-a36d41de-f39d-4a9a-a352-5a0628e90fd4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721973 May 27 15:24:51.396371 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 515/1036] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 15:24:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:24:51.404468 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=12 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:51.405548 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=24 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:51.411873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b629286e-e46b-4c3d-b1f5-a18b5799cdb9 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:51.412572 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b629286e-e46b-4c3d-b1f5-a18b5799cdb9 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:51.468698 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-b629286e-e46b-4c3d-b1f5-a18b5799cdb9 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:51.476277 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b629286e-e46b-4c3d-b1f5-a18b5799cdb9 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1094 microversion: 2.1 time: 0.073819 May 27 15:24:51.476882 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 522/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:51 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:52.494084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:52.494702 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:52.503080 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.503539 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.504316 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.504791 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.589521 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:52.597399 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-549ff9df-9801-4369-bec5-905bf46e363c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1210 microversion: 2.1 time: 0.107553 May 27 15:24:52.597963 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 516/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:52 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:53.615543 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:53.616391 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:53.623460 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.623922 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.624752 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.625197 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.849119 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:53.869457 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-e4068169-4198-49ca-bf89-f7619f8a8cad tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.257965 May 27 15:24:53.870352 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 523/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:53 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:53.873878 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-b341710f-8be1-46a9-90e1-136ba1073e4c req-fab55f78-9661-4408-9ff1-3ec080e283aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f5703d-99a0-48af-b97e-7f59c3e773ae", "tag": "7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:53.896899 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b341710f-8be1-46a9-90e1-136ba1073e4c req-fab55f78-9661-4408-9ff1-3ec080e283aa service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.897418 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-b341710f-8be1-46a9-90e1-136ba1073e4c req-fab55f78-9661-4408-9ff1-3ec080e283aa service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.910422 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-b341710f-8be1-46a9-90e1-136ba1073e4c req-fab55f78-9661-4408-9ff1-3ec080e283aa service nova] Creating event network-changed:7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f for instance 10f5703d-99a0-48af-b97e-7f59c3e773ae on hv-cinder-84254 May 27 15:24:53.915449 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-b341710f-8be1-46a9-90e1-136ba1073e4c req-fab55f78-9661-4408-9ff1-3ec080e283aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051044 May 27 15:24:53.916065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 517/1040] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:24:54.887286 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:54.887905 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:54.894484 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.894940 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:54.895712 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.896152 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:55.097214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:55.104858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-24fa8245-ef4f-4eb1-a072-ae5a44a3cbaf tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.221628 May 27 15:24:55.106143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 524/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:54 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:56.123820 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:56.124557 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:56.130830 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.131284 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.132056 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.132523 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.263674 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:56.271961 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-53c64fde-813a-4a73-aae6-962ce817edb8 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.153428 May 27 15:24:56.272545 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 518/1042] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:56 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:57.289569 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:57.290169 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:57.296284 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:57.296764 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:57.297531 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:57.297971 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:57.431145 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:57.439349 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-41cba448-be88-4b38-ad99-684fb0986c95 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.153813 May 27 15:24:57.439909 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 525/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:57 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:58.456744 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:58.457358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:58.463685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.464138 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.465308 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.465752 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.593037 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:58.600782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-e3d3bec1-1426-48d8-b504-db969b43ccdb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.147896 May 27 15:24:58.601353 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 519/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:58 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:59.618721 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:59.619327 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:59.625996 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.626453 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:59.627209 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.627651 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:59.759022 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:59.766657 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-7eab6e78-0107-4482-ab3e-61933f300b78 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.152210 May 27 15:24:59.767215 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 526/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:24:59 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:00.783776 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:00.784379 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:00.790828 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:00.791274 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:00.792030 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:00.792721 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:00.941741 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:00.951233 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-b414c010-bd9b-4198-b2a4-649fc225785d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.171181 May 27 15:25:00.951800 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 520/1046] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:00 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:01.968992 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:01.969559 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:01.972163 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell0:SELECT=2 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:01.977708 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.978154 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.978921 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.979359 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:02.111374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:02.118759 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-45b81f21-1ac0-4388-9949-0ad9c3959c99 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.154615 May 27 15:25:02.119316 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 527/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:01 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:03.136522 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:03.137077 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:03.139041 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=2 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:03.139689 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell0:SELECT=6 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:03.146115 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:03.146566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:03.147333 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:03.147770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:03.295849 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:03.303493 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-896cf671-2e34-4bbb-894f-06ecf2eea300 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.171641 May 27 15:25:03.304068 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 521/1048] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:03 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:04.320459 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:04.321095 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:04.328266 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:04.328805 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:04.329576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:04.330019 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:04.459539 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:04.467026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-69e0e165-15e5-4da3-bb15-b691c403ea0e tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.150493 May 27 15:25:04.467586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 528/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:04 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:05.484529 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:05.485320 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:05.491832 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.492374 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.493335 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.493846 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.612505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-bf61aea2-4696-45d5-8523-cfbf7e4b402d req-bd6a80c0-aa6e-4343-89fd-c6beb7e6ff09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f5703d-99a0-48af-b97e-7f59c3e773ae", "name": "network-vif-plugged", "status": "completed", "tag": "7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:05.621045 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bf61aea2-4696-45d5-8523-cfbf7e4b402d req-bd6a80c0-aa6e-4343-89fd-c6beb7e6ff09 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.621565 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-bf61aea2-4696-45d5-8523-cfbf7e4b402d req-bd6a80c0-aa6e-4343-89fd-c6beb7e6ff09 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.632826 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:05.635058 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-bf61aea2-4696-45d5-8523-cfbf7e4b402d req-bd6a80c0-aa6e-4343-89fd-c6beb7e6ff09 service nova] Creating event network-vif-plugged:7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f for instance 10f5703d-99a0-48af-b97e-7f59c3e773ae on hv-cinder-84254 May 27 15:25:05.641265 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-bf61aea2-4696-45d5-8523-cfbf7e4b402d req-bd6a80c0-aa6e-4343-89fd-c6beb7e6ff09 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179682 May 27 15:25:05.642083 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 522/1050] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:05.643498 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-6b972f69-4c93-4126-904b-d77da24cbe3f tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.162836 May 27 15:25:05.644150 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 529/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:05 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:06.662499 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:06.663114 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:06.669515 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.669966 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.670730 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.671166 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.806131 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:06.813759 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-21dbe564-0798-4dbe-953f-803b0cc3caac tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.156001 May 27 15:25:06.814356 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 523/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:06 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:07.831797 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:07.832494 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:07.839765 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:07.840325 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:07.841143 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:07.841589 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:07.976570 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:07.985106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-241ee8d8-132e-4e7e-a755-440f5da2dacb tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1266 microversion: 2.1 time: 0.157195 May 27 15:25:07.985692 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 530/1053] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:07 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:09.002084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:09.002706 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:09.009485 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.009968 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.011065 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.011522 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.144677 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:09.152645 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f0ccdd65-6fda-4f3a-8a0e-d1b82e56bda7 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1452 microversion: 2.1 time: 0.154438 May 27 15:25:09.153204 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 524/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:08 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:09.169082 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:09.169730 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:09.176147 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.176726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.177497 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.177947 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.320836 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:09.328302 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0eb3e92f-d8f6-45a8-86a9-fdf279592a0d tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1452 microversion: 2.1 time: 0.163579 May 27 15:25:09.328893 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 531/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:25:09 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:11.327650 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-baf65701-cb48-43ab-aa14-b8d4a99d81b9 req-eb303d1f-3ae3-4c1e-b859-fef71d5cf53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f5703d-99a0-48af-b97e-7f59c3e773ae", "tag": "7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:11.335657 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-baf65701-cb48-43ab-aa14-b8d4a99d81b9 req-eb303d1f-3ae3-4c1e-b859-fef71d5cf53e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:11.336109 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-baf65701-cb48-43ab-aa14-b8d4a99d81b9 req-eb303d1f-3ae3-4c1e-b859-fef71d5cf53e service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:11.348216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-baf65701-cb48-43ab-aa14-b8d4a99d81b9 req-eb303d1f-3ae3-4c1e-b859-fef71d5cf53e service nova] Creating event network-changed:7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f for instance 10f5703d-99a0-48af-b97e-7f59c3e773ae on hv-cinder-84254 May 27 15:25:11.353350 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-baf65701-cb48-43ab-aa14-b8d4a99d81b9 req-eb303d1f-3ae3-4c1e-b859-fef71d5cf53e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030083 May 27 15:25:11.353917 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 525/1056] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:43.455691 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:25:43.456151 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:25:43.984715 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:25:43.984951 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:26:54.410416 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_api:SELECT=22 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:54.411224 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG dbcounter [-] [117642] Writing DB stats nova_cell1:SELECT=54 {{(pid=117642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:54.413621 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:54.414541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG dbcounter [-] [117641] Writing DB stats nova_cell1:SELECT=50 {{(pid=117641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:54.415612 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:54.416123 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:54.419782 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-9fa9efe7-ac87-4326-bf2f-2cd8fa0e2be4 req-bc86d202-3920-4b34-9b78-5bba208789f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f5703d-99a0-48af-b97e-7f59c3e773ae", "tag": "7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:54.424355 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.424840 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.425668 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.426061 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.432217 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-9fa9efe7-ac87-4326-bf2f-2cd8fa0e2be4 req-bc86d202-3920-4b34-9b78-5bba208789f2 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.432711 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-9fa9efe7-ac87-4326-bf2f-2cd8fa0e2be4 req-bc86d202-3920-4b34-9b78-5bba208789f2 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.446459 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-9fa9efe7-ac87-4326-bf2f-2cd8fa0e2be4 req-bc86d202-3920-4b34-9b78-5bba208789f2 service nova] Creating event network-changed:7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f for instance 10f5703d-99a0-48af-b97e-7f59c3e773ae on hv-cinder-84254 May 27 15:26:54.452736 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-9fa9efe7-ac87-4326-bf2f-2cd8fa0e2be4 req-bc86d202-3920-4b34-9b78-5bba208789f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041845 May 27 15:26:54.453872 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 526/1057] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:26:54.454035 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:26:54.538723 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-bf6f7152-5ce6-4404-8593-2fd249250ed1 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 204 len: 0 microversion: 2.1 time: 0.130321 May 27 15:26:54.539616 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 532/1058] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:26:54 2022] DELETE /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:26:54.548390 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:54.549132 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:54.555566 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.556033 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.556865 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.557310 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.735910 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:54.744005 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-7ac03783-2d66-4710-9268-d12703098e84 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1577 microversion: 2.1 time: 0.199915 May 27 15:26:54.744617 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 527/1059] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:26:54 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:55.764232 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:55.765789 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:55.772041 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:55.772520 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:55.773292 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:55.773734 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:55.941858 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:55.949532 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-03661339-5355-4b12-9167-b0f0a292d2d4 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1577 microversion: 2.1 time: 0.189709 May 27 15:26:55.950093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 533/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:26:55 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:56.676949 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-486106c6-b0a4-4bb2-8f83-28912026f112 req-3ecda13e-2c75-4be2-8bf3-c7535df80dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f5703d-99a0-48af-b97e-7f59c3e773ae", "name": "network-vif-deleted", "tag": "7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:56.686134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-486106c6-b0a4-4bb2-8f83-28912026f112 req-3ecda13e-2c75-4be2-8bf3-c7535df80dc6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:56.686588 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-486106c6-b0a4-4bb2-8f83-28912026f112 req-3ecda13e-2c75-4be2-8bf3-c7535df80dc6 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:56.699593 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-486106c6-b0a4-4bb2-8f83-28912026f112 req-3ecda13e-2c75-4be2-8bf3-c7535df80dc6 service nova] Creating event network-vif-deleted:7b9aef87-2aa7-4dbd-9a68-dea818b3fe0f for instance 10f5703d-99a0-48af-b97e-7f59c3e773ae on hv-cinder-84254 May 27 15:26:56.705685 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-486106c6-b0a4-4bb2-8f83-28912026f112 req-3ecda13e-2c75-4be2-8bf3-c7535df80dc6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033226 May 27 15:26:56.706865 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 528/1061] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:56.967597 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:56.970675 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:56.977586 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:56.978230 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:56.978912 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:56.979356 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:57.054949 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:57.065021 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-0b38bf59-213e-411d-bf6a-291211d77ed3 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 200 len: 1225 microversion: 2.1 time: 0.101951 May 27 15:26:57.065620 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 534/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:26:56 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:58.084228 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:58.085331 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 10f5703d-99a0-48af-b97e-7f59c3e773ae] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:58.091577 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.092026 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.092822 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.093260 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.106768 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] HTTP exception thrown: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Request method failure captured: May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae HTTP/1.1 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOv3eVYBlvuLpZq-c_JsEqC4Ji7DSMQkXRwD5YPAe9YRkaAzQoH5vahjKXnxGugJWVJeifE8bEl2URHmb2f-wyVgz4-R8auOh2IRDz1ik0CoFb8LFf7OtGYmabU2QMm1bSjEJiLqFWYdBERqtzuliZp2MUFo8aZ97AsuzM_bbTBNauc May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:26:58.108358 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67116cdacaa846138f7835ac5f53b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestVolumeBootPattern-1427295069 May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestVolumeBootPattern-1427295069-project May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 60ff7c679e9747898bbc44da1d885b36 May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestVolumeBootPattern-1427295069-project May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. May 27 15:26:58.110656 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '10f5703d-99a0-48af-b97e-7f59c3e773ae'} May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:58.111806 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. May 27 15:26:58.113282 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:26:58.114510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Returning 404 to user: Instance 10f5703d-99a0-48af-b97e-7f59c3e773ae could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:58.114510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-dc8a8d19-6e5f-4bbd-9819-82195650c101 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae" status: 404 len: 111 microversion: 2.1 time: 0.031217 May 27 15:26:58.114510 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 529/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:26:58 2022] GET /compute/v2.1/servers/10f5703d-99a0-48af-b97e-7f59c3e773ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:01.171504 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:01.172053 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:01.178849 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.179350 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.180078 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-04e6ef0a-c4c3-4286-bfb1-cc75ff1e0ea0 req-6ef050ba-42f8-4f6b-95b0-335f7cce8ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f73f360-1774-417e-8c7e-f389b8ad5891", "tag": "d75474e9-e17b-408a-97d0-f07e572297fa"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:01.180551 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.180649 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.188335 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-04e6ef0a-c4c3-4286-bfb1-cc75ff1e0ea0 req-6ef050ba-42f8-4f6b-95b0-335f7cce8ea9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.188867 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-04e6ef0a-c4c3-4286-bfb1-cc75ff1e0ea0 req-6ef050ba-42f8-4f6b-95b0-335f7cce8ea9 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.200293 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-04e6ef0a-c4c3-4286-bfb1-cc75ff1e0ea0 req-6ef050ba-42f8-4f6b-95b0-335f7cce8ea9 service nova] Creating event network-changed:d75474e9-e17b-408a-97d0-f07e572297fa for instance 9f73f360-1774-417e-8c7e-f389b8ad5891 on hv-cinder-84254 May 27 15:27:01.205865 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-04e6ef0a-c4c3-4286-bfb1-cc75ff1e0ea0 req-6ef050ba-42f8-4f6b-95b0-335f7cce8ea9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029300 May 27 15:27:01.206840 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 530/1064] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:01.209799 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Going to try to terminate instance {{(pid=117642) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:27:01.294229 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-b75dca51-ac30-436d-85f9-52adfe502b5b tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 204 len: 0 microversion: 2.1 time: 0.126095 May 27 15:27:01.294867 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 535/1065] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:27:01 2022] DELETE /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:27:01.304245 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:01.305325 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:01.312164 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.313134 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.314497 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.315142 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.532775 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.policy [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117641) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:01.540563 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-222de42e-5162-4719-ab5b-7fb8272bfb00 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1577 microversion: 2.1 time: 0.240797 May 27 15:27:01.541123 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 531/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:27:01 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:02.558677 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:02.559713 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:02.567093 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.567609 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.568469 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.568966 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.753384 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:02.760975 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-21d81a32-b3a8-467a-872c-9caffbd6a968 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1577 microversion: 2.1 time: 0.206586 May 27 15:27:02.761538 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 536/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:27:02 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:03.389716 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [req-068fd0d8-4f50-43dd-91af-f9d5eacf0f48 req-60c3b8f8-005d-470c-b292-ab6a1cec5390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f73f360-1774-417e-8c7e-f389b8ad5891", "name": "network-vif-deleted", "tag": "d75474e9-e17b-408a-97d0-f07e572297fa"}]} {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:03.399553 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-068fd0d8-4f50-43dd-91af-f9d5eacf0f48 req-60c3b8f8-005d-470c-b292-ab6a1cec5390 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.400084 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [req-068fd0d8-4f50-43dd-91af-f9d5eacf0f48 req-60c3b8f8-005d-470c-b292-ab6a1cec5390 service nova] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.413088 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.compute.server_external_events [req-068fd0d8-4f50-43dd-91af-f9d5eacf0f48 req-60c3b8f8-005d-470c-b292-ab6a1cec5390 service nova] Creating event network-vif-deleted:d75474e9-e17b-408a-97d0-f07e572297fa for instance 9f73f360-1774-417e-8c7e-f389b8ad5891 on hv-cinder-84254 May 27 15:27:03.417769 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [req-068fd0d8-4f50-43dd-91af-f9d5eacf0f48 req-60c3b8f8-005d-470c-b292-ab6a1cec5390 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 May 27 15:27:03.418372 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 532/1068] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 15:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:03.778450 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:03.779063 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:03.786903 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.787221 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.788110 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.788814 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.824214 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.824719 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.825165 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.objects.instance [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lazy-loading 'fault' on Instance uuid 9f73f360-1774-417e-8c7e-f389b8ad5891 {{(pid=117642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:27:03.866766 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.policy [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ff7c679e9747898bbc44da1d885b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67116cdacaa846138f7835ac5f53b863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117642) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:03.874106 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-d7e28b77-6d11-4be0-a1e9-175e1c22cfed tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 200 len: 1230 microversion: 2.1 time: 0.099614 May 27 15:27:03.874667 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 537/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:27:03 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:03.944140 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:27:03.944486 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Fri May 27 15:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:27:04.892855 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:04.893541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: 9f73f360-1774-417e-8c7e-f389b8ad5891] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:04.899985 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:04.900436 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:04.901223 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:04.901658 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:04.914653 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] HTTP exception thrown: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Request method failure captured: May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 HTTP/1.1 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOv3eVYBlvuLpZq-c_JsEqC4Ji7DSMQkXRwD5YPAe9YRkaAzQoH5vahjKXnxGugJWVJeifE8bEl2URHmb2f-wyVgz4-R8auOh2IRDz1ik0CoFb8LFf7OtGYmabU2QMm1bSjEJiLqFWYdBERqtzuliZp2MUFo8aZ97AsuzM_bbTBNauc May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:27:04.916261 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67116cdacaa846138f7835ac5f53b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 60ff7c679e9747898bbc44da1d885b36 May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. May 27 15:27:04.918249 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': '9f73f360-1774-417e-8c7e-f389b8ad5891'} May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:04.919259 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. May 27 15:27:04.921031 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:04.923148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Returning 404 to user: Instance 9f73f360-1774-417e-8c7e-f389b8ad5891 could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:04.923148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-f14038c1-45af-49ad-b63d-42034166b40c tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891" status: 404 len: 111 microversion: 2.1 time: 0.029775 May 27 15:27:04.923148 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 533/1070] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:27:04 2022] GET /compute/v2.1/servers/9f73f360-1774-417e-8c7e-f389b8ad5891 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:05.363396 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:05.363933 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.compute.api [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117642) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:05.370588 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.371045 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.371818 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.372254 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG oslo_concurrency.lockutils [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.386085 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.wsgi [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] HTTP exception thrown: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Request method failure captured: May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: request: DELETE /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db HTTP/1.1 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept: application/json May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Accept-Encoding: identity May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Connection: close May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Length: 0 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Content-Type: application/json May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Host: 10.222.0.41 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Openstack-System-Scope: None May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: User-Agent: python-urllib3/1.26.9 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Auth-Token: gAAAAABikOv3eVYBlvuLpZq-c_JsEqC4Ji7DSMQkXRwD5YPAe9YRkaAzQoH5vahjKXnxGugJWVJeifE8bEl2URHmb2f-wyVgz4-R8auOh2IRDz1ik0CoFb8LFf7OtGYmabU2QMm1bSjEJiLqFWYdBERqtzuliZp2MUFo8aZ97AsuzM_bbTBNauc May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Id: None May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Domain-Name: None May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Identity-Status: Confirmed May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Is-Admin-Project: True May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Id: default May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Domain-Name: Default May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Project-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Role: member,reader May 27 15:27:05.387613 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Roles: member,reader May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67116cdacaa846138f7835ac5f53b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-Tenant-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Id: default May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Domain-Name: Default May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Id: 60ff7c679e9747898bbc44da1d885b36 May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: X-User-Name: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: method: > May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: exception: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.389329 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: action_args: {'id': 'cbd6a168-957b-4d55-ab12-8663ff7d32db'} May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:05.390343 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.392576 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR nova.api.openstack.wsgi May 27 15:27:05.397964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Returning 404 to user: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. {{(pid=117642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:05.397964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-5fec6dfa-b212-4a47-8bb3-65ef62e19ae6 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 404 len: 111 microversion: 2.1 time: 0.030379 May 27 15:27:05.397964 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 538/1071] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 15:27:05 2022] DELETE /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:05.398739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '>' {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:05.398739 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.compute.api [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [instance: cbd6a168-957b-4d55-ab12-8663ff7d32db] Fetching instance by UUID {{(pid=117641) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:05.404516 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.404976 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.405770 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.406216 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG oslo_concurrency.lockutils [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Lock "d5764852-9660-42e1-b8ea-3e2314bb2d69" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.420014 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.wsgi [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] HTTP exception thrown: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Request method failure captured: May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: request: GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db HTTP/1.1 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept: application/json May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Accept-Encoding: identity May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Connection: close May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Length: 0 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Content-Type: application/json May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Host: 10.222.0.41 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Openstack-System-Scope: None May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: User-Agent: python-urllib3/1.26.9 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Auth-Token: gAAAAABikOv3eVYBlvuLpZq-c_JsEqC4Ji7DSMQkXRwD5YPAe9YRkaAzQoH5vahjKXnxGugJWVJeifE8bEl2URHmb2f-wyVgz4-R8auOh2IRDz1ik0CoFb8LFf7OtGYmabU2QMm1bSjEJiLqFWYdBERqtzuliZp2MUFo8aZ97AsuzM_bbTBNauc May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Id: None May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Domain-Name: None May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Identity-Status: Confirmed May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Is-Admin-Project: True May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Id: default May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Domain-Name: Default May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Project-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Role: member,reader May 27 15:27:05.421550 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Roles: member,reader May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67116cdacaa846138f7835ac5f53b863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67116cdacaa846138f7835ac5f53b863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Id: 67116cdacaa846138f7835ac5f53b863 May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-Tenant-Name: tempest-TestVolumeBootPattern-1427295069 May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Id: default May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Domain-Name: Default May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Id: 60ff7c679e9747898bbc44da1d885b36 May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: X-User-Name: tempest-TestVolumeBootPattern-1427295069-project May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: method: > May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: exception: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.423842 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: action_args: {'id': 'cbd6a168-957b-4d55-ab12-8663ff7d32db'} May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: {{(pid=117641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:05.425556 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. May 27 15:27:05.427094 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: ERROR nova.api.openstack.wsgi May 27 15:27:05.428393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: DEBUG nova.api.openstack.wsgi [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Returning 404 to user: Instance cbd6a168-957b-4d55-ab12-8663ff7d32db could not be found. {{(pid=117641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:05.428393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO nova.api.openstack.requestlog [None req-9001877c-2668-4a47-b12e-a88be15dbb41 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db" status: 404 len: 111 microversion: 2.1 time: 0.030233 May 27 15:27:05.428393 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: [pid: 117641|app: 0|req: 534/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 15:27:05 2022] GET /compute/v2.1/servers/cbd6a168-957b-4d55-ab12-8663ff7d32db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:06.712863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: DEBUG nova.api.openstack.wsgi [None req-fe814258-de28-40e1-a5e5-18a4e6bacc54 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] Calling method '.version_select at 0x7fa3720b0c10>' {{(pid=117642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:06.716026 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe814258-de28-40e1-a5e5-18a4e6bacc54 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [8f798e7f-d9c8-490f-a855-a7393b9a8cd3] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:27:07.724403 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe814258-de28-40e1-a5e5-18a4e6bacc54 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] [8f798e7f-d9c8-490f-a855-a7393b9a8cd3] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41124. May 27 15:27:07.744180 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO nova.api.openstack.requestlog [None req-fe814258-de28-40e1-a5e5-18a4e6bacc54 tempest-TestVolumeBootPattern-1427295069 tempest-TestVolumeBootPattern-1427295069-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-938155760" status: 202 len: 0 microversion: 2.1 time: 1.035275 May 27 15:27:07.744790 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: [pid: 117642|app: 0|req: 539/1073] 10.222.0.41 () {58 vars in 1259 bytes} [Fri May 27 15:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-938155760 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:29:03.088976 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:29:03.089505 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Fri May 27 15:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:29:03.464314 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:29:03.464873 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:30:23.954133 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:30:23.954719 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Fri May 27 15:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:13.713348 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:13.713863 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:23.097035 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:23.097541 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Fri May 27 15:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:23.472919 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:23.473436 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:23.996507 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:23.996726 dv-cinder-842541-3-iscsi devstack@n-api.service[117642]: Fri May 27 15:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:34.542784 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:34.543383 dv-cinder-842541-3-iscsi devstack@n-api.service[117641]: Fri May 27 15:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!